Presented by: hitps://jatrilibrary.com 


HANDBOOK OF RESEARCH ON 


COMPUTER-ENHANCED 
LANGUAGE 
ACQUISITION 
AND LEARNING 


Presented by: https://jafrilibrary.com 


Handbook of Research on 
Computer-—Enhanced 
Language Acquisition 
and Learning 


Felicia Zhang 
University of Canberra, Australia 


Beth Barber 
University of Canberra, Australia 


InformationScience || NFORMATION SCIENCE REFERENCE 
REFERENCE Hershey - New York 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Acquisitions Editor: Kristin Klinger 

Development Editor: Kristin Roth 

Senior Managing Editor: Jennifer Neidig 

Managing Editor: Sara Reed 

Copy Editor: Jennifer Young and Katie Smalley 
Typesetter: Amanda Appicello 

Cover Design: Lisa Tosheff 

Printed at: Yurchak Printing Inc. 


Published in the United States of America by 
Information Science Reference (an imprint of IGI Global) 
701 E. Chocolate Avenue, Suite 200 
Hershey PA 17033 
Tel: 717-533-8845 
Fax: 717-533-8661 
E-mail: cust@igi-global.com 
Web site: http://www.igi-global.com 
and in the United Kingdom by 
Information Science Reference (an imprint of IGI Global) 
3 Henrietta Street 
Covent Garden 
London WC2E 8LU 
Tel: 44 20 7240 0856 
Fax: 44 20 7379 0609 
Web site: http:///www.eurospanbookstore.com 


Copyright © 2008 by IGI Global. All rights reserved. No part of this publication may be reproduced, stored or distributed in any form or by 
any means, electronic or mechanical, including photocopying, without written permission from the publisher. 


Product or company names used in this set are for identification purposes only. Inclusion of the names of the products or companies does 
not indicate a claim of ownership by IGI Global of the trademark or registered trademark. 


Library of Congress Cataloging-in-Publication Data 
Handbook of research on computer-enhanced language acquisition and learning / Felicia Zhang and Beth Barber, editors. 
p.cm. 

Summary: “This book provides comprehensive coverage of successful translation of language learning designs utilizing ICT in practical 
learning contexts. It offers researchers, scholars, students, and professionals worldwide, access to the latest knowledge related to research on 
computer-enhanced language acquisition and learning”--Provided by publisher. 

Includes bibliographical references and index. 

ISBN-13: 978-1-59904-895-6 (hardcover) 

ISBN-13: 978-1-59904-896-3 (ebook) 

1. Language and languages--Computer-assisted instruction. I. Zhang, Felicia. II. Barber, Beth. 

P53.28.H36 2008 

418’.00285--dc22 


2007036856 


British Cataloguing in Publication Data 
A Cataloguing in Publication record for this book is available from the British Library. 


All work contributed to this book set is original material. The views expressed in this book are those of the authors, but not necessarily of 
the publisher. 


Ifa library purchased a print copy of this publication, please go to http://www.igi-global.com/reference/assets/IGR-eAccess-agreement. 
pdf for information on activating the library's complimentary electronic access to this publication. 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


List of Reviewers 


Alejandro Curado 
University of Extremadura, Spain 


Angela Chambers 
University of Limerick, Ireland 


Anjel Tozcu 
Multi-Language School, Presidio of 
Monterey, USA 


Cameron Richards 
University of Western Australia, 
Australia 


Diane Huot 
Universite Laval, Quebec, Can- 
ada 


Dilara Demirbulak 
Cankaya University, Turkey 


Delores Ramirez Verdugo 
Universidad Autonoma de Madrid, 
Spain 


Faridah Pawan 
Indiana University, USA 


Fernanda Freire 
University Estadual de campinas, 
Brazil 


Gabriella Brussino 
University of Auckland, New 
Zealand 


Gulcan Ercetin 
Bogazici University, Turkey 


Gumock Jeon-Ellis 
University of Melborne, Australia 


HanhThi Nguyen 
Hawii Pacific University, USA 


Hazel Morton 
University of Edinburgh, UK 


Jeong Bae-Son 
University of Southern Queensland, 
Australia 


Joel Bloch 
The Ohio State University, USA 


Jorg Roche 
Universitat Miinchen, Germany 


Kenneth Reeder 
The University of British Columbia, 
Canada 


Kirk Sullivan 
Umea University, Sweden 


Leo Yu 
Hong Kong Baptist University, Hong 
Kong 


Linda Jones 
University of Arkansas, USA 


Margarita Vinagre 
Nebrija University, Spain 


Marie Stevenson 
University of Sydney, Australia 


Martina Mollering 
Macquarie University, Australia 


Michael Fitze 
Dubai Women’s College, UAE 


Miriam Scholnik 
Tel Aviv University, Israel 


Nattaya Puakpong 
Suranaree University of Technology, 
Thailand 


Panayiotis Zaphris 
City University, UK 


Pramela Krish 
University Kebangsaan, Malaysia 


Presented by: https://jafrilibrary.com 


Radia Azzam-Hannnachi 
Université Nancy 2, France 


Rita de Cassia Marriott 
Pontificial Catholic University of 
Parana, Brazil 


Rolf Kreyer 
University of Bonn, Germany 


Shannon Johnston 
University of Queensland, Australia 


Stella K. Hadjistasssou 
Arizona State University, USA 


Stephen Alan Shucart 
Akita Prefectural University, Japan 


Terence C. Ahern 
Akita Prefectural University, Japan 


Terence Patrick Murphy 
Yonsei University, South Korea 


Thomas Hansson 
University of Southern Denmark, 
Denmark 


Wei-Pang Lien 
ShuTe University, Republic of China 


Yuping Wang 
Griffith University, Australia 


Maliwan Buranapatana 
Khon Kaen University, Thailand 


Sue Otto 
The University of Iowa, USA 


Dennie Hoopingarner 
Michigan State University, USA 


Jozef Colpaert 
University of Antwerp, Belgium 


Andrew Lian 
Western Illinois University, USA 


Presented by: https://jafrilibrary.com 


Table of Contents 


MQEO WOK 5s sstecceveca tested fecevcucbeccescscecusdocducsesvecusveseadessadecucndecteess suheunus deevexadeatecs seen vovdecduevacetcevaeciveecatete xviii 

1 ot Ps [6-H PE ee ae ee XX 

Acknowledgment .............::ccccesccssscessesseeesceesecesecsecseseneesseecsecssecsecsseeeaeeessecseceaecseecaeseaeeeneecseceseeees XXVili 
Section I 


Online Resources for Language Learning 


Chapter I 

Australasian Language Learners and Italian Web Sites: A Profitable Learning Partnership? ................ 1 
Gabriella Brussino, University of Auckland, New Zealand 
Cathy Gunn, University of Auckland, New Zealand 


Chapter II 
Assessing the Benefit of Prewriting Conferences on Drafts .........ccccecceessesseeseceseceseceseeeeeeeaeecseceeeeeeees 20 
Michael Fitze, Dubai Women’s College, UAE 


Chapter III 

Blogging and Academic Writing Development .............ceecessssseesnseeecenseceseceseeeaeeeseeeatesaeceaeceseeeeeseneeenees 36 
Joel Bloch, The Ohio State University, USA 
Cathryn Crosby, West Chester University, USA 


Chapter IV 

Second Language Reading in Hypertext Environment ...........cscccssecscsescssscececeeceeeceeceeseeeaeeaeecsaeceaeees 48 
Robert Ariew, University of Arizona, USA 
Giilcan Er¢etin, Bogazici University, Turkey 
Susan Cooledge, University of Maryland Eatern Shore, USA 


Chapter V 


Application of Online Questionnaires in Grammar Teaching ......... cc eeceesececeseeeeceeceeeeeeeeeeeceeceaeeneeenees 64 
Leo Kam-hung Yu, Hong Kong Baptist University, Hong Kong 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Chapter VI 


ICT and Language Learning at Secondary School ...........ccsssesseseesseeseceeeceeeeeeeeeeeeceeeseeeseeees 


Diane Huot, Université Laval, Québec, Canada 
France H. Lemonnier, Université Laval, Québec, Canada 
Josiane Hamers, Université Laval, Québec, Canada 


Chapter VII 


Computer-Enhanced Grammar Teaching............ccccesccssssssseeeesseceseceseceseseneeeaeeaaeceaeceaecneeseneesnes 


David Barr, University of Ulster, Northern Ireland 


Section I 
Multimedia and Speech Technology in Language Learning 


Chapter VIII 


Research-Based Listening Tasks for Video Comprehensi00 ............sccsceeeceseceeceeeeeeeeeceeeeaeeneees 


Luba V. Iskold, Muhlenberg College, USA 


Chapter IX 


Invested Mental Effort in an Aural Multimedia Environment............cccccccccccceceeeseceseseececesecece 


Linda Jones, University of Arkansas, USA 


Chapter X 


A Computer-Based Reading Tutor for Young Language Learners ...........cccceseesseestessteeteeeteeees 


Kenneth Reeder, The University of British Columbia, Canada 
Jon Shapiro, The University of British Columbia, Canada 
Margaret Early, The University of British Columbia, Canada 
Maureen Kendrick, The University of British Columbia, Canada 


Chapter XI 


Supporting the Reflective Language Learner with Computer Keystroke Logging ................ 


Eva Lindgren, Umea University, Sweden 
Marie Stevenson, The University of Sydney, Australia 
Kirk P. H. Sullivan, Umea University, Sweden 


Chapter XII 


Grammar Animations and Cognition ........ccscccsccesscesscesceeeesscesaeceaeceaeceeeeeeeeeaeesaecsaeceaecnseseneesaes 


J6érg Roche, Ludwig-Maximilians-Universitdt Miinchen, Germany 
Julia Scheller, Ludwig-Maximilians-Universitdt Miinchen, Germany 


Chapter XIII 


Evaluation of a Speech Interactive CALL System .........cceccccseessecsseeseceseceeeeeseeeseeeneeeeeeseeees 


Hazel Morton, University of Edinburgh, UK 
Nancie Davidson, University of Edinburgh, UK 
Mervyn Jack, University of Edinburgh, UK 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Chapter XIV 


Pedagogy Meets Technology in the Somatically-Enhanced Approach ........eceseeeereereeees 


Maliwan Buranapatana, Khon Kaen University, Thailand 
Felicia Zhang, University of Canberray, Australia 


Chapter XV 


Training for Learning Mandarin Tomnes.........ceccesccseeseccessceseseeeeeesecacaeeaeeeceeceaecaeeeeeenseass 


Xinchun Wang, California State University, USA 


Chapter XVI 


An Evaluation of a Listening Comprehension Program .........ccccsssccsseeeeceesceeseeseeeseeeneeeseens 


Nattaya Puakpong, Suranaree University of Technology, Thailand 


Section III 
CMC and Language Acquisition and Learning 


Chapter XVII 


CMC for Language ACqUISILION...........:cccscceseceteceeceeeeseeeeeeesecesecuaeceseeeeeseneceaecaaeceaeceaeeeneeees 


Terence C. Ahern, West Virginia University, USA 


Chapter XVIII 


A Task-Based Design for Integrating E-Mail with FL Pedagogy .........esescssseceeeeceeeeseees 


Shannon Johnston, The University of Queensland, Australia 


Chapter XIX 


The Role of Error Correction in Online Exchanges.........cccceccesssesseecseceesceeeceeeeeeeeeeecseceseees 


Margarita Vinagre, Antonio de Nebrija University, Spain 
Maria Lera, Antonio de Nebrija University, Spain 


Chapter XX 


Emerging Feedback in Two Asynchronous ESL Writing Forums ..........seeeeceseeseeeeeeeeee’ 


Stella K. Hadjistassou, Arizona State University, USA 


Chapter XXI 


CMC and Intercultural Learning... eeceeseceseceseceseeeseeeseeeseceaeceaeceseeeneseneceaecaeceaeceseeeneeees 


Martina Mollering, Macquarie University, Australia 
Markus Ritter, Ruhr-Universitdt Bochum, Germany 


Chapter XXII 


Developing L2 Strategic Competence Online .........eceeceeccesseeseeeseeeeceseceeceseeeseeeseeeseceaeens 


Claudia Finkbeiner, University of Kassel, Germany 
Markus Knierim, University of Kassel, Germany 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Chapter XXIII 


Interventions and Student Factors in Collaboration..........ccccccccccsssssssscceceseessescessesessseesessseseeeees 


Faridah Pawan, Indiana University, USA 
Senom T. Yalcin, Indiana University, USA 
Xiaojing Kou, Indiana University, USA 


Section IV 
The Use of Corpora in Language Acquisition and Learning 


Chapter XXIV 


Corpora in the Classroom and Beyond ........::csccesccssscesseeseeesceeseceeeeeeceseecseecaeeesecseecseeeeseeesaeenaees 


Rolf Kreyer, University of Bonn, Germany 


Chapter XXV 


Sharing Corpus Resources in Language Learming..........ccceccessessessseeseceeceeeceneeeseeeaeecseceseeeseeeees 


Angela Chambers, University of Limerick, Ireland 
Martin Wynne, University of Oxford, UK 


Chapter XXVI 


The Texture of Inefficiently Self-Regulating ESL Systems ........ccecessecsseceseeeeceeeeeeeeeseeeseeeeeeens 


Terence Patrick Murphy, Yonsei University, Korea 


Section V 
Self-Access Support for Language Acquisition and Learning 


Chapter XXVII 


Technology in Support of Self-Access Pedagogy........cccesccsssssssesseeeeessecsseceseseeceeeeseeeeseecaeeaeees 


Hayo Reinders, University of Hawaii, USA 
Noemi Ldzaro, Universidad Nacional de Educacion a Distancia (UNED), Spain 


Chapter XXVIII 


The CALL Lab as a Facilitator for Autonomous Learning........ccceccessecsseceseeeeceeeeeeeeeeeeneeenaeens 


Stephen Alan Shucart, Akita Prefectural University, Honjo Campus, Japan 
Tsutomu Mishina, Akita Prefectural University, Honjo Campus, Japan 
Mamoru Takahashi, Akita Prefectural University, Honjo Campus, Japan 
Tetsuya Enokizono, Akita Prefectural University, Honjo Campus, Japan 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Section VI 
Future Directions in Language Teaching 


Chapter XXIX 
Applying TTS Technology to Foreign Language Teaching... ceeeesssssesceseeeeceeeceeceaeeaeeeeeereeaeeneeees 497 
Junichi Azuma, University of Marketing and Distribution Sciences, Japan 


Chapter XXX 
Using an Audio-Video Chat Program in Language Learning ..........cceccsseceseeesceeeceeseeseeeseecneeeeceeeeeees 507 
Yuko Kinoshita, University of Canberra, Australia 


Compilation of References ...............ccccccccsscesscessceseesseecseeesceseceeeceseseaeecseeeseeeseceeceeeseaeeeaeecueeeeneeesees 521 
About the Comtributors .............cccccccccccccccsccccsssssssscccccscssssesccsccseseceeecsscescessceessssecesesesesssessesseeaseaees 568 
DYN esse cc acces ces Seceg cect eve es eeceudh Gecaucccucueaseatucuscetccdesneespusseuees deeveceseisbevs sien seiseeeedecies tees 577 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Detailed Table of Contents 


ECW OE rece octets ccc cc dese ed Seen ea veace cede tees udecdueeeesvevsues eeducasdevasedonte ext satussusscevevstaviecs deeeversees eset xviii 

| 223 Spee OE Ee eR XX 

Acknowledgment .............:cccccesccesscesessseesscessecsecsecseceneeeseecsecsaecsecsseeeaeeeseecseceseceseceeaseaaecsaesseceseeaes XXVili 
Section I 


Online Resources for Language Learning 


This section contains seven chapters covering various uses of online resources for language learning. 
The section contains an evaluation of an approach to second language learning involving Italian Web 
sites; a study comparing the benefits of written electronic conferences over face-to-face conferences as 
pre-writing activities in an ESL classroom; a study that utilizes blogging in a beginning level academic 
writing course; a chapter summarizing up to date research on the use of hypertext/hypermedia in second 
language reading; two accounts of using WebCT questionnaire tools for the teaching of grammar in EFL 
and in learning French as a second language and a longitudinal evaluation of the integration of IC T in 
the secondary school language curriculum in Quebec, Canada. 


Chapter I 

Australasian Language Learners and Italian Web Sites: A Profitable Learning Partnership? ................ 1 
Gabriella Brussino, University of Auckland, New Zealand 
Cathy Gunn, University of Auckland, New Zealand 


The study reports on a series of studies involving beginning L2 learners of Italian engaged in a theo- 
retically driven and technology enhanced approach to second language acquisition at the University of 
Auckland, New Zealand. Evaluation data gathered over a five-year period provided the basis for con- 
tinuous improvement and is presented as evidence of effectiveness of the learning design and teaching 
strategies involved. 


Chapter II 
Assessing the Benefit of Prewriting Conferences on Drafts 0.0... ceeseessesecsseneeeeeesececeeeeceeececeaeeneeenens 20 


Michael Fitze, Dubai Women’s College, UAE 


This chapter reports on a comparative study of face-to-face (FTF) and written electronic (WE) conferences 
as pre-writing activities in the English as a second language (ESL) classroom. Twenty-seven intermedi- 
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ate to advanced students participated in the study over a four-week period. Although no difference was 
found in the length, or semantic or lexical complexity of first drafts, the results indicated that students 
made better use of the terms and ideas introduced during the FTF conferences when individually writ- 
ing first drafts. 


Chapter III 

Blogging and Academic Writing Development ............cceeccessssessnseeeceeseceseceseeeaeeeeeeeaeesaeceaeceseseneseneeenees 36 
Joel Bloch, The Ohio State University, USA 
Cathryn Crosby, West Chester University, USA 


This chapter discusses the use of blogging in a beginning-level academic writing course. Blogging was 
used in the course as a means of interacting with the other students and as a means of discussing issues 
the students were to write about in their classroom assignments. It is argued in this chapter that the use 
of blogs allows the students to develop a variety of rhetorical strategies outside the confines of the course 
that could then be transferred into the students’ academic writing assignments. 


Chapter IV 

Second Language Reading in Hypertext Environment ...........cccccssececeesceescececseecseeceeceeseeeaeeseecsaecsaeees 48 
Robert Ariew, University of Arizona, USA 
Giillcan Er¢etin, Bogazici University, Turkey 
Susan Cooledge, University of Maryland Eatern Shore, USA 


This chapter introduces second language reading in hypertext/hypermedia environments. It discusses the 
development of a template to annotate reading texts with multiple types of media such as texts, sound 
graphics and video so as to aid reading comprehension for L2 readers. 


Chapter V 
Application of Online Questionnaires in Grammar Teaching ......... ec ecescesesceecceseceseeeeeeeeeceeceaeeneeeeens 64 
Leo Kam-hung Yu, Hong Kong Baptist University, Hong Kong 


The consciousness-raising approach to grammar teaching aims to provide opportunities for students to 
identify some grammatical components through noticing activities and then make their own hypotheses 
about those components. This chapter proposes the application of the WebCT questionnaire to develop 
outside-class activities through which students are able to practice the target language and test and refine 
their hypotheses in order to internalize the grammar rules in a Chinese university. 


Chapter VI 

ICT and Language Learning at Secondary School ..........cccescssssesseeenceeeceseceeeeeeeeseeeaeenaeceaeceseseeeeeneeenees 84 
Diane Huot, Université Laval, Québec, Canada 
France H. Lemonnier, Université Laval, Québec, Canada 
Josiane Hamers, Université Laval, Québec, Canada 


This chapter presents the key findings of a longitudinal study conducted with secondary school students 


over a period of five years to determine whether the use of ICT has any influence on the learning of L1 
French and L2 English in Quebec, Canada. 
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Chapter VII 
Computer-Enhanced Grammar Teaching..........ccsccesccsscsssessscessecseeceeceeceeeseseeseecaaecaueceecsseeseeeeneeeaeeesees 101 
David Barr, University of Ulster, Northern Ireland 


This chapter reports on the results of a study undertaken to gauge what difference computer technology 
makes to grammar learning. The chapter outlines how traditional grammar classes have been adapted 
for delivery in a multimedia situation and assesses the impact in terms of students’ perceptions about 
learning of grammar and in their actual performance that the computer has on the process. 


Section I 
Multimedia and Speech Technology in Language Learning 


This section contains chapters on the use of multimedia and speech technology in language learning. 
The languages being covered ranged from learning Mandarin Chinese as a foreign language, learning 
Thai as a foreign language, ESL, learning German, Japanese and Italian in the foreign language con- 
texts. The focuses of the chapters ranged from pedagogical implementation of a multi-modal language 
learning approach, to the use of automated speech recognition technology in language learning. Studies 
involving the use of keystroke logging, animation, and listening comprehension software are described 
in this section. 


Chapter VIII 
Research-Based Listening Tasks for Video Comprehension .............:ssseeeseceesececeeeceeceeeceaeeaeeaeeeeeeaes 116 
Luba V. Iskold, Muhlenberg College, USA 


This study examines the effects of listening tasks performed by L2 learners of Russian. The research 
investigates the use of online video guides designed to be used by the learners during video viewing. 
The research examines whether students using video guides achieved greater comprehension and reten- 
tion of the videotext in Russian. In addition to objective tests, the researcher investigates participants’ 
opinions regarding the effectiveness of video guides. 


Chapter IX 
Invested Mental Effort in an Aural Multimedia Environment... cscs ceeeseeressececeeececceeeceaeeaeeneeeneeaes 136 
Linda Jones, University of Arkansas, USA 


This study addresses the views of nine students on the amount of the invested mental effort needed to 
effectively process multimedia annotations so as to learn from a second language aural passage. 


Chapter X 
A Computer-Based Reading Tutor for Young Language Learners ........eeecsecssceseeeeceeceseeeeeeteneeaeenee 159 
Kenneth Reeder, The University of British Columbia, Canada 
Jon Shapiro, The University of British Columbia, Canada 
Margaret Early, The University of British Columbia, Canada 
Maureen Kendrick, The University of British Columbia, Canada 
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This chapter describes the first year of research on the effectiveness of automated speech recognition 
(ASR) technology for English as second language (ESL) learners in the early school years. The aim was 
to learn how a prototype research software entitled the Reading Tutor (RT) can enhance literacy learning 
in second language development. In addition to assessing learners’ gains in reading scores on a standard- 
ized measure, the attitudinal dimension of speech recognition technology was also investigated. 


Chapter XI 

Supporting the Reflective Language Learner with Computer Keystroke Logging ..........cccessesseeeees 189 
Eva Lindgren, Umed University, Sweden 
Marie Stevenson, The University of Sydney, Australia 
Kirk P. H. Sullivan, Umeda University, Sweden 


In this chapter an instructional format, peer-base intervention using computer keystroke logging, is 
investigated as a computer technology to enhance English language acquisition. 


Chapter XII 

Grammar Animations and Cognition .........cccccssccsseceseceseeeseeeseescecseecsaececseeeeeeesseecaeecaaecaeceeeseeeeseeeaeeesaes 205 
J6érg Roche, Ludwig-Maximilians-Universitdt Mtinchen, Germany 
Julia Scheller, Ludwig-Maximilians-Universitdt Mtinchen, Germany 


This study focuses on the learning and teaching of German grammatical rules in various modes of pre- 
sentation. Four groups of informants were formed to test four different combinations of the presented 
materials. The groups used either a cognitive/functional or traditional rule-governed approach to gram- 
mar explanation in either an animation or static presentation mode. The results document the overall 
superiority of the cognitive/functional approach to grammar when presented in the animation mode. 


Chapter XIII 

Evaluation of a Speech Interactive CALL System ........ ccc ceeeescesseeesceseeceeeceseeeeeseseeeeeesaecaeceseeeeeeeneeees 219 
Hazel Morton, University of Edinburgh, UK 
Nancie Davidson, University of Edinburgh, UK 
Mervyn Jack, University of Edinburgh, UK 


This chapter describes the design of a speech interactive CALL program and its evaluation with end us- 
ers. The program SPELL(spoken electronic language learning) combines speech recognition technology, 
embodied animated agents and virtual worlds in creating an environment in which learners can converse 
with virtual characters in the target language in real time. 


Chapter XIV 

Pedagogy Meets Technology in the Somatically-Enhanced Approach .......ecesseseeseeseeeeceteeeeneeeeeeaes 240 
Maliwan Buranapatana, Khon Kaen University, Thailand 
Felicia Zhang, University of Canberray, Australia 


This chapter reports on a study which evaluates the effect of the language teaching approach called the 
‘somatically-enhanced approach’ in the teaching of Thai to Vietnamese in Vietnam. Innovations evaluated 
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include the use of relaxation techniques to relax students, the use of humming, clapping and physical 
gestures to emphasize the rhythm of Thai and the use of a speech comparison tool and the provision of 
all learning materials on CD ROMs. 


Chapter XV 
Traiming for Learning Mandarin Tones\...sssii.csssedscssssedessesteeesssestcensdeesces sees causaesvansssdessdantvensesececssaadecsess 259 
Xinchun Wang, California State University, USA 


This study explores the effect of two training paradigms, previously used in laboratory based train- 
ing, for learning Mandarin tones in pedagogical contexts. The aim of the research is to show that both 
training paradigms are effective and laboratory based training techniques can be implemented in CALL 
contexts. 


Chapter XVI 
An Evaluation of a Listening Comprehension Program. ...........csccesscessseseeeseeeeeceseceseceeeeaeeeaeeeseceaeenseens 275 
Nattaya Puakpong, Suranaree University of Technology, Thailand 


This chapter evaluates a computer-enhanced language learning listening comprehension program 
(MMExplore) on students’ listening comprehension ability in the context of learning English as a foreign 
language in the Thai university system. MMExplore is an audio-visual media browser which is designed 
to provide learners with a wide variety of ways to interact with authentic listening texts. 


Section II 
CMC and Language Acquisition and Learning 


The chapters in this section concerns the use of computer-mediated communication for language learning 
purposes. Starting with a chapter on how to effectively design tasks that maximizes student engagement 
in the learning process, chapters on the implementation of CMC in various contexts are then presented. 
Then, it ends with a study that aims to address the problem of serial monologues in student online dis- 
cussions and participation. Research reported in this section suggest that though CMC is very useful for 
language acquisition and learning, the role of the teacher is still essential. 


Chapter XVII 
CMC for Langtiage A CoUISitl OMvassecges sazczceuvcatennsiscacotecasdedens adver ciadansedennssadegeaescddesacesdaseeacdagleacaegavadenies 295 
Terence C. Ahern, West Virginia University, USA 


This chapter discusses how to effectively choose the CMC software most effective for epistemic engage- 
ment to achieve discourse, communicative and linguistic goals. 


Chapter XVIII 


A Task-Based Design for Integrating E-Mail with FL Pedagogy .........escscsseesceeeceeceseeeeeeeeneeaeeneeees 307 
Shannon Johnston, The University of Queensland, Australia 
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This chapter presents a discussion of e-mail tasks within a task-based framework based on evidence 
from a study carried out in a senior secondary school Indonesian class in Queensland, Australia. With 
this proposal, the author hopes to inform teachers and stimulate research of task-based e-mail as a peda- 
gogically rigorous teaching method. 


Chapter XIX 

The Role of Error Correction in Online Exchanges.........cccesssscssscesssesseceeeceseeeeeseseeeneeaeceaeceaeeeeeeeeeeees 326 
Margarita Vinagre, Antonio de Nebrija University, Spain 
Maria Lera, Antonio de Nebrija University, Spain 


In this chapter, the role that error correction plays in fostering language development via e-mail tandem 
exchanges is investigated. Findings of a year-long e-mail exchange between specialist learners of English 
at Nebrija University in Madrid and non-specialist learners of Spanish at Trinity College Dublin during 
the academic year 2005-2006 are presented. The findings of this study suggest that corrective feedback, 
especially when it takes the form of remediation, can lead to language development in on-line exchanges 
since it encourages recycling of errors in later e-mail messages. 


Chapter XX 
Emerging Feedback in Two Asynchronous ESL Writing Forums qu... .ccecseeseseceeeeceeceeeceaeeaeeaeeeeeeaes 342 
Stella K. Hadjistassou, Arizona State University, USA 


This study discusses how an individual activity of formulating a tentative paper topic can be turned 
into a culturally-transforming group activity by employing asynchronously-mediated forums on the 
“discussion board” of Blackboard Academic Suite. The data suggest that participation in asynchronous 
computer-mediated communication (ACMC) forums can encourage them to implement describing, nar- 
rating strategies to provide feedback to their peers as well as improving their writing skills by developing 
more formal, sophisticated and complex language. 


Chapter XXI 

CMC and Intercultural Learning... eceecessecsecesecesseeseeeseescecsaeceueceeceseeseceeseecseecsaecseceaeeeaceaeecaeecsaes 361 
Martina Mollering, Macquarie University, Australia 
Markus Ritter, Ruhr-Universitdét Bochum, Germany 


This chapter explores how CMC might contribute to language learning and teaching. Starting off with 
an overview of the development of research in this field, a model for the analysis of successful telecol- 
laboration procedures and processes is used for the discussion of a German-Australian exchange. 


Chapter XXII 
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This chapter reports on a semester-long, Web-based project to facilitate the development of L2 strategic 
competence by means of online collaboration among advanced EFL (English as a foreign language) 
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learners. The project—called the “Online Learner ABC’s”—combines an autobiographic approach to 
raise the learners’ awareness of their own strategy use with data-driven activities to foster diagnostic 
skills with regard to strategy use. 
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This research explores what happens in online discussions when four teacher interventions designed 
to increase collaboration are introduced. The secondary aim of the study is to address the problem of 
serial monologues in student online discussions and participation. The findings yield factors that im- 
pact student online collaboration such as student familiarity with the subject matter and with the online 
medium; purpose and timing of online engagement; importance of face-saving; and student acceptance 
of the ‘constructed knower’ role. 


Section IV 
The Use of Corpora in Language Acquisition and Learning 


The three papers contained in this section discuss the complexity of using corpora in language learning 
especially in learner-centered approaches. However, the conclusion reached by all three papers is that it 
1S a cooperative enterprise between teachers and students in order to maximize the potential of corpora 
in language acquisition. 
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Rolf Kreyer, University of Bonn, Germany 


This chapter outlines a fundamental prerequisite for student use of corpora. Such a corpus competence 
will not only help students to make use of corpora in the classroom but will also prepare the grounds for 
use of corpora in non-institutionalized contexts and as a tool for life-long learning. 
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This chapter aims to investigate the issues arising if corpus consultation is to become an integral part of 
the language-learning environment especially with small teacher produced corpus. After dealing with 
fundamental questions concerning the creation and reusability of corpora, it then explores the issues 
arising from the use of a corpus of familiar texts, in this case a French journalistic corpus, with advanced 
learners. In conclusion a framework for the optimal use of corpora with language learners in the context 
of higher education is proposed. 
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Chapter XXVI 
The Texture of Inefficiently Self-Regulating ESL Systems... ccc eeecesecssessseeeseeeeeesaeceaeceseeeeeseneeees 453 
Terence Patrick Murphy, Yonsei University, Korea 


This chapter addresses the question of how to measure the student’s English as a second language (ESL) 
textual sophistication at the levels of grammar, lexis and logico-rhetorical structure. 


Section V 
Self-Access Support for Language Acquisition and Learning 


This section contains two chapters on self-access support for language learning. Starting with an evalu- 
ation of 46 self-access centers throughout the world, the second chapter describes the conceptualization 
of an autonomize learning space for self access learning in Japan. 


Chapter XXVII 

Technology in Support of Self-Access Pedagogy.......csccsccessssessseeessesseceaeceseeeseeeseseneesaecaeceseeeeeeeneeees 469 
Hayo Reinders, University of Hawaii, USA 
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This chapter discusses the results of the study into the use of technology in self access centers. As part 
of the study, 46 self-access centres in six countries were evaluated. This chapter reports on the results 
of the evaluation . 
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This chapter describes how the CALL lab at Akita Prefectural University was designed by a group of 
trained CALL professionals and language teachers with the needs of the students in mind. The results 
of this project provided important feedback to allow for the instigation of cutting edge Web 2.0 innova- 
tions, specifically the open source of the .VL E called Moodle. 


Section VI 
Future Directions in Language Teaching 


In this section, two chapters describing the use of text-to-speech technology and the use of an audio- 
video chat program in language teaching have been included. The chapter on the use of text-to-speech 
technology is particularly interesting as it has the potential to solve the problem of not having enough 
English native speakers as models in learning English as a foreign language contexts such as Japan. 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Chapter XXIX 
Applying TTS Technology to Foreign Language Teaching... ee ceeescsesesceeeeeceseeaeeseeeeeeaeeaeeneeeneeaes 497 
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This study describes how the synthesized English speech sound generated by a commercial TTS engine 
(Pentax “VoiceText’’) is utilized within a CALL classroom environment as well as within the Moodle- 
based e-learning environment for an EFL class in a Japanese private university. In this chapter, the author 
argues that a TTS synthesized speech material can open a new horizon in foreign language teaching, 
implementing a ubiquitous multimedia learning environment at a significantly low cost. 
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Using an Audio-Video Chat Program in Language Learning ...........ccesceseceseeeeeeeeeseeneeceaeceeeeeeeeneeees 507 
Yuko Kinoshita, University of Canberra, Australia 


This chapter presents a descriptive report on of a video chat project undertaken in early 2006 at the 
University of Canberra, Australia using iChat. The report contains a detailed account of the methodol- 
ogy and observations made on student behavior and motivation to the project. The project showed that 
there is great potential for video chat to be used as a language learning tool. 
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Foreword 


I am delighted to write the foreword for the Handbook of Research on Computer-Enhanced Language 
Acquisition and Learning, as its scope and content provide educational institutions and commercial 
computer software enterprises with practical information from the field of language learning for the 
successful implementation of computer technology. People have been experimenting with the uses of 
computer-assisted language learning (CALL) since the beginnings of computing. Wonderful and impor- 
tant mainframe-based systems, such as PLATO, were created and used to teach languages to significant 
numbers of students. Yet, these systems were reserved essentially for those elites that had access to these 
large and expensive systems. CALL, like other forms of technology-supported learning, has only truly 
captured the imagination of the language teaching profession since the advent of the microprocessor which 
began to democratize access to computing. Thus, CALLas, a major field of endeavor for “the masses,” 
has been in existence for only a very short time: less than three decades. It is such a new field! 

From the very beginning of the microprocessor revolution, computing for all appeared to become a 
reality and the critical mass of people involved in the field multiplied exponentially, thus hugely increas- 
ing the intellectual commitment to the field. Such increasing intellectual commitment is demonstrated 
by the authors of the 30 chapters who contributed to this handbook. 

Many of the authors invested in personal computers and hurried to produce the ultimate piece of 
language-learning software. Some wrote their own code (usually BASIC but sometimes Pascal or even 
machine language), others had to wait for the freedom afforded by the invention of Hypercard and sys- 
tems like it. These were days of great hope and great ambition. There were also days of great frustration 
for two apparently contradictory reasons. 

On one hand, the potential of the technology had outstripped the thinking processes involved with 
its application to language-teaching and learning. This often resulted in software which entrenched 
outdated teaching and learning paradigms. People argued that this was better than nothing. On the other 
hand, paradoxically, the technology was not sufficiently advanced to satisfy the hopes and aspirations 
of imaginative theoreticians of language learning who had been dreaming of the days when affordable 
computing would become available. Having theorized these systems, they were now keen to turn theory 
into practice, but were unable to do so because of the limitations of the technology. 

The field of CALL/CELL/TELL is now maturing and heading toward a better balance between 
technology and thinking. While the technology is still developing faster than our thinking processes and 
we are still driving forward while, we are, inevitably, looking in the rear-vision mirror. We learned to 
recognize and deal more effectively with the dissonance between the speed of technological development 
and the speed of our thinking. This handbook provides some documentary evidence that, while dealing 
with the dissonance between the speed of technological development and the speed of our thinking, 
there is something genuinely to be gained in using technology in language learning. Technology and 
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our thinking process not only co-exist side by side, they also intersect in many interesting ways so as to 
inspire new thinking process and new ways of using technology alike. 

This handbook contains a number of reports which provide us with information on how some of the 
tools that we had been waiting for reduced the frustrations of the past and, how they provided us with 
wonderful opportunities for thinking differently and imaginatively about the teaching and learning of 
languages. 

The handbook of research on computer-enhance language acquisition and learning abounds with 
descriptions of how CALL practitioners from all over the world have taken advantage of these opportu- 
nities in remarkably different, yet eminently practical, ways to the clear benefit of the language-learning 
enterprise as a whole. It offers practical knowledge derived from implementation of technology based on 
theories of second language acquisition, multimedia learning, and theories from cognitive psychology. 
Its multi-disciplinary approach is most welcome. It represents an original and important contribution to 
the state of the art. It will help to build the future of CALL while, at the same time, provide a valuable 
historical record of the state of play in the early 21st century. 


Professor Andrew Lian 

Professor of Foreign Languages and Literatures and 

Chair of the Department of Foreign Languages and Literatures 
Western Illinois University 

USA 


Andrew Lian specializes in the methodology of teaching foreign/second languages and has had a special interest in the 
uses of modern technology to enhance learning since the late 1970s. He is one of the pioneers of technology-enhanced lan- 
guage-learning in Australia. Currently, he is professor and chair of the department of foreign languages and literatures at 
Western Illinois University in the United States. He has held professorial appointments and been head of department in four 
universities in Australia and the United States. His current research interests include the development and use of multimedia 


databases in language teaching and learning. 
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Preface 


BACKGROUND 


Over the last 30 years, dramatic changes have taken place in the ways that languages are taught. Language 
learning has moved from the learning of discrete grammatical structures to the fostering of communica- 
tive ability. The role of the learner has changed from being a recipient of grammatical structures to that 
of a creator and user of language. In the field of second language acquisition (SLA), it has also been 
realized that to be a proficient speaker of an L2 learners have to comprehend input from other speakers; 
they must produce comprehensible output through speaking and writing and be able to communicate 
appropriately according to the rules of the L2 culture. Culture is such an all-encompassing concept that 
though its importance has been recognized, there continues to be much (heated) debate about how it 
should be or could be taught (Kramsch, 1993; Kraus, 2003). The development of information commu- 
nication technology (ICT) has also created many learning paths that can assist the process of learning 
an L2. With the availability of CD-ROMs, multimedia computer labs, the World Wide Web and e-mail, 
learners are able to access foreign language documents, and communicating with native speakers, teachers 
and fellow classmates through email or text messages has become an everyday reality. In other words, 
in the twenty first century, while the use of ICT in language learning by teachers is still not widespread 
(Abdal-Haqq, 1995; Cotton, 1995), learners have enthusiastically taken up various forms of technology 
despite the reluctance of teachers. 

From the teaching perspective, there has been considerable published research exploring the rela- 
tionship between the use of ICT and language learning. However, the simple question: ‘Does the use 
of ICT lead to better language learning?’ still cannot be adequately answered. This might be because 
what is involved in language or language learning is still not well understood, let alone what constitutes 
“better” language learning. As observed by Zhang (2006), “Language and the human mind are not a 
well-charted terrain whose waterways are now rendered easily navigable. Linguists, psychologists, 
neurologists and even philosophers have made bold forays along some of the more easily recognized 
estuaries and returned with sketchy maps. Yet we do not know enough to know how (or even if) these 
maps fit together (p.35).” 

As for the interaction of ICT and language learning, Warschauer and Kern (2000) observe that the 
computer, like any other technological tool used in teaching (e.g., pencils and paper, blackboards, 
overhead projectors, tape recorders), does not in and of itself bring about improvement in learning. We 
must, therefore, look to particular practices of use in particular contexts in order to begin to answer the 
question. Furthermore, these practices of use must be described as well as evaluated in terms of their 
specific social context. For instance, who were the learners? What exactly did they do? For what pur- 
pose? In what setting? With what kinds of language? In what patterns of social interaction? What were 
the particular outcomes in terms of quantity/quality of language use, attitudes, motivation? 
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PURPOSE AND SCOPE OF THE HANDBOOK 


This book deals with the use of ICT in language learning. It is designed to be a comprehensive source 
of information providing researchers and teachers with a number of empirical studies that are based on 
sound pedagogy and are properly evaluated. The intention is to illustrate the development and growth 
in the use of ICT in language learning. Moreover, as is evident from the title, the book does not confine 
itself to research defined by any particular definition of computer assisted language learning (CALL). In 
other words, while acknowledging the contribution of CALL in the fields of study such as SLA or foreign 
language teaching (FLT), the intent is also to look beyond such disciplinary concerns and include examples 
of best practice in relevant areas of mainstream computer science such as speech technology. 

The handbook presents cases of ICT use in language learning in which ICT is considered neither as 
an adjunct or tool for learning nor as a method of instruction in itself. One of the aims of the book is to 
present cases of successful interaction of ICT tools and pedagogy rather than just ICT tools or pedagogy 
alone. 

The past few years have seen a number of comprehensive summaries of relevant research in CALL 
(Felix, 2001; Salaberry, 2001; Warschauer & Healey, 1998). Therefore, rather than reiterating what has 
been described before, in this preface, being the first chapter of this volume, the emphasis is on the role 
of learners and learning in the history of approaches to second language education and the particular 
history of CALL is briefly described. 


SHIFTING PERSPECTIVES OF ROLE OF LEARNERS AND LEARNING 


In recent history of language teaching changes that are evident in language teaching and learning can be 
characterized by the overlapping of three theoretical movements: structural, cognitive, and sociocogni- 
tive. These movements have also influenced how computer technology has been used in language teach- 
ing and learning. Therefore, we begin by briefly summarizing the development of these perspectives. 
Warschauer and Kern (2000) provide details of the respective instructional foci of the three perspectives 
in Table 1. 


Structural Perspective 


In the structural perspective, language was viewed as an autonomous structural system consisting of 
vocabulary, grammatical structures and prescriptive rules. Therefore, language learning is defined as 
the mastery of the various components of the structural system and this is accomplished, according to 
behaviorism (Skinner, 1938), by imitating the language stimulus and then receiving either positive or 
negative reinforcement. Teaching is carried out through the transmission of knowledge from competent 
users such as teachers and native speakers. The role of learners involves imitating the structures and 
developing habits through constant repetition and correction from a teacher or a competent user of the 
target language. The primary unit of teaching is usually isolated sentences. The success of learning is 
judged by examining the quality of the final products of learners. 


Cognitive Perspective 


In the early 1960s, Noam Chomsky (1959) rejected B.F. Skinner’s behaviorist notion of language learn- 
ing, arguing for the vital part played by the mental activities of the language learner himself and strongly 
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questioning the relevance of external factors such as imitation, frequency of stimulus and reinforcement. 
Chomsky further argued that because a speaker of a language can produce (and understand) an infinite 
number of well-formed utterances, language competence could not possibly be explained by a model 
based on imitation and habit information. Instead, Chomsky proposed a transformational-generative 
grammar which assumed that the ability to learn languages is innate. The development of an individual’s 
grammatical system is guided by innate cognitive structure such as the “language acquisition device” 
(LAD) and not by behavioral reinforcement. 

Chomsky’s theory contributed to the paradigm shift from that of instilling language habits in learn- 
ers to enquiring how learners construct the second language syntactic system mentally. Thus, errors 
produced by learners came to be seen as signs of second language development. This new perspective 
has led to a renewed interest in grammar which culminated in Krashen’s Input Hypothesis (Krashen, 
1985), a theory which emphasizes the importance of providing comprehensible input (grammatically) 
to enable the internal working out of the L2 language’s grammatical system rather than an explicit 
teaching on grammar rules. For Krashen, language input is not to foster authentic social interaction 
but rather to give individuals an opportunity to mentally construct the grammar of the language from 
extensive natural data. From this perspective, learners have become active agents capable of generating 
and transforming knowledge. 


Sociocognitive Perspective 


As the cognitively-oriented perspective on language acquisition was gaining popularity, Dell Hymes 
(1971) coined the term “communicative competence” in response to Chomsky’s mentalist characteriza- 
tion of linguistic competence, thus emphasizing the importance of the social appropriateness of language 
use. At the same time, Michael Halliday (1978) emphasized the need to consider language from a func- 
tional perspective. Halliday (1978) posited three functions of language use: ideational, interpersonal 
and textual. While the ideational function of language use has customarily been dealt with in language 
teaching, the interpersonal function (i.e., use of language to maintain social relations) and the textual 
function (i.e., to create situationally relevant discourse) has largely been neglected. Both Hymes and 
Halliday consider language as a socially constructed phenomenon rather than something that occurs in 
a language user’s head. Hymes (1978) argued that, “There are rules of use without which the rules of 
grammar would be useless.” 

During the 1980s, language instruction embraced communicative competence wholeheartedly and 
culminated in a series of more learner-centered and less structurally driven instructional methodologies. 
In these methodologies language instruction was viewed not just in terms of providing comprehensible 
input, but also in terms of helping students enter into the kinds of authentic social discourse situations 
and discourse communities that they would later encounter outside the classroom. With these method- 
ologies, learners, for the first time, are no longer passive vessels to be filled. They play an active role, 
internalizing the linguistic stimuli but also using a variety of communication strategies to manage both 
the content and the process of communication. 

In summary, in the development of language teaching pedagogy a learner’s role has developed from 
being a repetition machine to a person who somehow internalizes the language, to a person who not only 
repeats and internalizes the language input but also participates actively in the management of social 
and communicative exchange. 
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CHANGING NATURE OF COMPUTER USE IN LANGUAGE TEACHING 


Shifts in perspectives on language learning and teaching have paralleled developments in technology. 
Many of the early computer programs for language learning are heavily influenced by the theoretical 
movements in the history of language teaching and learning. Early examples of vocabulary tutorials and 
drill and practice programs are programs influenced by the structural perspective in language learning. 
In recent times the use of computer mediated communication (CMC) is influenced by the sociocognitive 
perspective on language learning (Warschauer, 2004, 2005). 

Linguistics or theories of second language acquisition, however, have also been barriers to the de- 
velopment of ICT for language learning. For instance, in pronunciation training of a L2 language, years 
of research have been devoted to the teaching of segments (consonants and vowels, minimal pairs) to 
the neglect of suprasegmental aspects (intonation, prosody, and stress) of L2 languages. Though the 
importance of the suprasegmental aspects of language use has been recognized, most research into the 
use of ICT for enhancing the teaching of pronunciation involves products developed from research into 
language learning and related fields such as speech recognition (Derwing, Munro & Wiebe, 1998; Neri, 
2001; Neri, Cucchiarini & Strik, 2003). Notably, while research in second language research is directed 
towards segments, research into the production of speech recognition tools for e-commerce is highly 
relevant and has significantly increased our understanding of the prosodic aspects of many languages. 
Research findings from e-commerce, as well as the more traditional areas, can beneficially feed back 
into language learning. 

The World Wide Web has long been touted as the new medium for organizing, linking and access- 
ing information. Using the World Wide Web, students can search through millions of files around the 
world, thus gaining instant access to authentic materials that correspond to their personal interests. They 
can also use the Web to publish their own texts or multimedia creations in the public domain. As Kern, 
Ware, and Warschauer (2004) point out, “These features [of the World Wide Web] can facilitate an ap- 
proach to technology use in which authentic and creative communication is integrated into all aspects 
of the course” (Kern, Ware & Warschauer, 2004, p. ). New technologies, such as the World Wide Web, 
and new information and communications technology such as wireless communication, broadband con- 
nections and mobile computing technology also have changed the learning contexts and extended them 
beyond the classroom. Learners now can engage in self-access learning by means of the Internet; they 
can participate in online forums through a variety of means such as e-mail, listserv, internet relay chat 
programs, internet telephony systems such as Skype as well as interact in MOOs. 

The promise of the World Wide Web and online learning, however, has not been realized for learn- 
ers. Although online learning encourages collaboration, the efficacy of integrating such technology 
into a language curriculum is still open to debate and requires further research. Whether technology 
can provide social contexts that are needed to promote second language learning is still hotly debated. 
Consequently, many researchers are investigating the use of pedagogical agent within online learning 
to enhance social interactions online (Dowling, 2002). Such research findings can certainly enhance 
online language learning as well. 

To summarize, quite evidently the computer can play multiple roles in language learning. An ex- 
amination of education related literature in computer science suggests that we have much to learn about 
technological development. To take full advantage of technology for language learning, it is necessary 
for students, teachers, linguists, applied linguists, and educationalists to step out of their respective fields 
and talk to the computer scientists who are instrumental in realizing the technology needed to better 
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learning. Understanding language is always a multi-disciplinary endeavor. In this case of successfully 
and beneficially integrating ICT into language learning, the dialogue between computer scientists and 
language educationalists is essential, to make sure that the technology created does in fact enhance 
learning. 

From the learning perspective, the central factor influencing the learners’ choice of engagement is 
still motivation. In other words, the job facing every teacher or curriculum designer is still, and prob- 
ably will continue to be, how to motivate learners to seek out possible ways of using ICT to interact 
with native speakers of a target language themselves and so enhance their own learning. Motivation in 
language learning has had a long history in second language research. 

Dornyei (2003) put forward a model of a motivational learning practice which is multifaceted. In 
his model, no single computer program, no matter how well thought out or designed, can possibly cre- 
ate the kind of motivational learning environment envisaged. Therefore, it is vitally important when 
incorporating ICT in the language learning process that the relationship between ICT activities and 
the learning pedagogy be thoroughly considered. For instance, for a particular context such as learners 
learning beginning Spanish, the incorporation of a Web search activity in the learning process might not 
be beneficial to learners at all as they might be overloaded with too much information. Such an activity 
would probably lead to learners feeling less confident and they would probably find little enjoyment or 
stimulation in undertaking it. However, for the same group of Spanish learners, if the activity is a Web 
quest on a Spanish cinema site, and learners only have to collect information such as the names of actors 
in a specific film, then the task can be accomplished and is unlikely to overload learners. 

Past research has shown that many teachers remain skeptical of the value of computer use in language 
learning. One of the reasons might be the piece-meal nature and poor quality of the research that has 
been conducted. Based on a review of some 78 articles published in four CALL-oriented journals from 
2000-2003, Hubbard (2005) noticed the following inadequacies in most of the research: 


° There are a small number of subjects, partly because the research often takes place with a single 
intact class. 

. Surveys or questionnaires of both attitudes and patterns of use are employed in place of more 
objective evaluative measures. 

. The research subjects often engage in the task/activity or use the application for only a short time, in 
many cases in just a single session with a new tutorial program or application (e.g., online chat). 

. Participants are studied during their initial experience with the task, activity, or application. 

. Participants are novices to CALL: this may be the first time (or one of the first times) they have 
tried to use computers to support their language learning. 

. Participants are novices to the general type of task, activity or application under study; for instance, 
they are attempting something they have never done in more “traditional” forms, such as on paper, 
through audio or video tape, or in a face to face classroom setting. 

° Participants are untrained before the study: they receive neither technical nor pedagogical tutoring 
that could assist them in using the application or performing the task effectively to meet learning 
objectives. 

. Participants are undirected during the study: although there may be monitoring of their activity, 
once the study begins there is no intervention by either teachers or researchers. 


The inadequacies summarized by Hubbard (2005) demonstrate the fact that interaction between 
pedagogy and ICT is not adequately researched and that research in the area is not adequately evalu- 
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ated. This handbook is an attempt to fill this gap. A call went out for submissions based on best practices 
which have the following characteristics: 


. If possible, studies should have a large number of subjects either in a single intact class or in a 
cross-sectional setting. 

. While acknowledging the usefulness of surveys or questionnaires as instruments for data collec- 
tion, this volume calls for studies with more rigorous evaluation. 

. Studies that involve both novices to CALL and non-novice subjects. 

° Studies which are longitudinal in nature or involving subjects in a longer period of time than a few 
hours per week. 

. Studies that involve participants who have received adequate training before the experiments. 

. Studies that attempt to eliminate the novelty effects. In other words, studies which consider the 
use of ICT as part of the overall design of the methodology used for the learning process. 

. Therefore, the activities or tasks the students attempted to do through the use of ICT should form 
part of the normal “traditional” tasks and be part of the usual learning methodology. ICT is chosen 
not because it is there and therefore we must use it, but because it has a firm place in the language 
learning methodology. 

° Studies that redefine the role of teachers and students in the learning process. 

. Studies that report students learning English as a second or foreign language or any other Euro- 
pean languages such as French or language of another script such as Japanese, Chinese, Arabic, or 
Thai. 

. Studies that are concerned with new contexts: that is, moving away from classroom bound contexts 
to informal, self study, non-institutionalized contexts. 

. Studies that emphasize the need to equip students with skills that facilitate the transition from 
institutionalized contexts to non-institutionalized contexts. 


The primary objective of the handbook is to improve our understanding of what language learning 
entails in such a way that language learning designs utilizing ICT can translate successfully into practice. 
Hence, empirically grounded evaluations of learning are especially important. 


THE IMPORTANCE OF THE CHAPTER SUBMISSIONS 


The chapter submissions in this volume include many cases of successful international collaborations. 
In order to provide the best balanced coverage of research related to the selected topics of this hand- 
book, researchers from around the world were asked to submit proposals. All proposals were carefully 
reviewed by the editors in light of their suitability, researcher’s records of similar work in the area of the 
proposed topics and the best proposal for topics with multiple proposals. Upon the receipt of full entry 
submissions, each submission was forwarded to at least three expert external reviewers on a double- 
blind, peer review basis. In many cases, submissions were sent back for several revisions prior to final 
acceptance. As a result, this handbook includes 30 chapters highlighting current research conducted 
in the field of computer-enhanced language learning. The 30 submissions came from knowledgeable 
researchers around the world: while many submissions from the United States were accepted (seven 
chapters), five chapters from Australia, three from the United Kingdom, two from Japan, New Zealand 
and Thailand, one from Germany, Spain, Korea, Sweden, Hong Kong, Turkey and Dubai. Contributions 
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involved a variety of contexts including tertiary education and secondary schools. While the majority 
of the chapters involved empirical studies in the implementation of ICT for language learning, chapters 
that describes innovative use of technology such as text-to-speech technology and audio-video chats 
have also been included. 

Heeding the inadequacies summarized by Hubbard (2005) and outlined previously, many of the 
chapters selected for publication are longitudinal in nature and employ both quantitative and qualitative 
evaluation instruments. In these chapters, whether ICT has been integrated within the overall design of 
the methodology used in the language learning process is a key factor. The international nature of this 
volume is demonstrated by the inclusion of many chapters which report on the learning of Mandarin, 
Thai, German, French, and English in foreign language learning contexts. 

The diverse and comprehensive coverage of the interaction between language learning and ICT in 
this authoritative handbook will contribute to our understanding of how ICT can be successfully imple- 
mented in a variety of language learning contexts. The coverage of this handbook provides strength to 
this reference resource for language professionals who seek inspiration and new ideas to implement in 
their classrooms; equally, it is useful for researchers in applied linguistics who might want to replicate 
some of the studies reported in this handbook. For computer scientists, this handbook can also provide 
information on how to translate products from computer sciences to real life language learning contexts. 
It is our sincere hope that this publication and its great amount of information and research will assist 
our research colleagues, or faculty, their students and our organizational decision makers in enhancing 
their understanding of the language teaching and computer-enhanced language learning and acquisition 
fields. 
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Section | 
Online Resources for 
Language Learning 


This section contains seven chapters covering various uses of online resources for language learning. 
The section contains an evaluation of an approach to second language learning involving Italian Web 
sites; a study comparing the benefits of written electronic conferences over face-to-face conferences as 
pre-writing activities in an ESL classroom; a study that utilizes blogging in a beginning level academic 
writing course; a chapter summarizing up to date research on the use of hypertext/hypermedia in second 
language reading; two accounts of using WebCT questionnaire tools for the teaching of grammar in 
EFL and in learning French as a second language and a longitudinal evaluation of the integration of 
IC T in the secondary school language curriculum in Quebec, Canada. 
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Chapter | 
Australasian Language Learners 


and Italian Web Sites: 
A Profitable Learning Partnership? 


Gabriella Brussino 
University of Auckland, New Zealand 


Cathy Gunn 
University of Auckland, New Zealand 


ABSTRACT 


A theoretically driven and technology enhanced approach to second language acquisition at beginners 
level is illustrated through the description of an iterative learning design process implemented at the 
University of Auckland, New Zealand. The study draws on three areas of current literature: SLA/FLA, the 
use of authentic tasks and integration of subject specific and generic skills. Beginners enrolled in Italian 
language courses engage with authentic media, public service and entertainment web sites. Through 
this engagement, learners are guided in the acquisition of a range of language structures, vocabulary, 
cultural knowledge and communication skills. Evaluation data gathered over a five-year period provided 
the basis for continuous improvement and is presented here as evidence of effectiveness of the learning 
design and teaching strategies involved. 


INTRODUCTION limits learners’ exposure to authentic language 

and cultural input, and thus risks rendering the 
The teaching and learning of Italian language in classroom a sterile or artificial study environ- 
the context of the Australasian classroom presents ment. Considerable effort is devoted to avoiding 
unique challenges. Isolation from the target culture such potentially negative influence on learner 
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interest, motivation and performance. Beginning 
in 1994, a number of theoretically driven, tech- 
nology supported learning initiatives have been 
leveraged to address these challenges (Brussino, 
1996, 1999; Gunn & Brussino, 1997). Advances 
in multimedia, information and communication 
technologies have made valuable additions to the 
teacher’s toolkit (see e.g. Sinyor, 1998), and they 
now facilitate both mediated and direct access 
to authentic sources of information that can be 
integrated into language learning activities. 
This chapter focuses in detail on one such 
initiative, where an online research and reporting 
task isa key activity for students taking a first year 
program. Italian media, fashion industry, popular 
music, weather reports, and public transport Web 
sites are identified as information sources for 
an assessed task. Learners are required to read, 
interpret, and re-present information, then to 
reflect on the strategies of language and culture 
learning they engaged with during this process. 
Overall performance on task together with invited 
feedback received over a five-year period support 
the initial hypothesis that guided exploration of 
Internet sites can foster independent learning 
as well as development of effective language 
learning strategies. These activities are effective 
in promoting deep understanding of the target 
language structures, as well as providing insight 
into key aspects of the culture and representing a 
stimulating and profitable learning experience. 
In addition to language learning outcomes, 
there are opportunities for students to acquire 
technology skills that are a key component of the 
institution’s generic graduate attributes. These 
skills are required in practically all areas of pro- 
fessional life and their integration into subject- 
based courses aligns with current beliefs about 
effective learning of generic skills in technology 
rich environments. The chapter aims to outline an 
appropriate theoretical basis for design of this type 
of activity with integral use of technology tools, 
and to offer a detailed description of the iterative 
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development process for the online activities, 
including annual evaluation and improvement 
cycles. The overall purpose is to present evidence 
that technology tools do indeed offer unique op- 
portunities for second/foreign language teachers 
to articulate theoretical concepts for the benefit 
of their students. 


BACKGROUND: THE PROGRAMME 
OF STUDY 


The beginners’ Italian program at the University 
of Auckland consists of two courses: Italian 
Language for Beginners A and B, taught over 
consecutive semesters. Students enrolled in these 
courses may have studied Italian at night school, 
though evidence shows that the majority of learn- 
ers have no prior knowledge of the language or 
culture. The courses are based on an integrated 
approach in which the following components in- 
terlace: interaction in class; study of atextbook; a 
tailor-made CALL laboratory designed to provide 
practice and reinforcement opportunities and to 
contextualize the learning that takes place in 
class; and a Web-based research and resource 
development project where new resources are 
produced by the learners in collaboration with 
their teacher. 
Aims of the beginners’ program are: 


. Development of effective language learning 
strategies 

. Fostering independent learning 

° Raising awareness of the sociocultural 
context surrounding language. 


Learning objectives are: 


° Effective communication in the most basic 
day-to-day situations and contexts 

. Ability to describe oneself, one’s family, 
work, interests, and studies 
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. Writing for various purposes in formal and 
informal styles 

. Understanding written information 

° Selective comprehension of spoken lan- 
guage 

. Working on pronunciation, intonation and 
accent 

. Developing basic structural knowledge. 


The acquisition of basic language structures 
and grammatical notions is an important core 
skill requirement of the program. 

The courses attract a range of students with 
different educational backgrounds and their rea- 
sons for studying Italian from intention to travel, 
because of family connections, general interest 
and the need to gain more points to complete a 
degree. The majority of students are in the 18-23 
age group, though some are mature learners in the 
25 plus age group and a few are over 50. Students 
engage in four contact hours per week and are 
required to work independently in the computer 
laboratory for at least an additional hour each 
week. Although this has proved challenging in 
the past, a large majority of students now come 
with enough computer skills to complete the tasks 
required of them as all courses at the institution 
now require use of the online learning manage- 
ment system. Language work and interaction in 
class are designed to make language learning a 
meaningful and relevant experience for the stu- 
dents and class activities are centered on group 
work. Regular participation is required of the 
students, as 60 percent of the assessment is car- 
ried out during the course, and only 40 percent 
at the final examination. As one component in 
a language course, Web-based resources can be 
effectively used to complement interaction in 
class and interactive exercises available in CD- 
ROM format. 


MAIN FOCUS: THE ROLE OF WEB 
RESOURCES 


Learner and teacher collaboration in the early 
years of the initiative described in this chapter 
resulted in production of a series of Web pages 
aimed at providing learning support resources 
that the students would considered meeting their 
specific needs. These Web pages contain adminis- 
tration and course management details; arange of 
materials designed to support the various course 
activities; links and resources providing rich con- 
tent related to the cultural topics covered and a 
guide to all major structures of the language. The 
Web site design activity was considered to align 
withthe task-based approach that Kumaravadivelu 
(2006) suggests has replaced the communicative 
language teaching (CLT) approach, and uses key 
elements of Ellis’s (2003) synthesized definition 
of a task, that is: 


“A task is a workplan that requires learners to pro- 
cess language pragmatically in order to achieve 
an outcome that can be evaluated in terms of 
whether the correct or appropriate propositional 
content has been conveyed. To this end, it requires 
them to give primary attention to meaning and 
to make use of their own linguistic resources ... 
A task is intended to result in language use that 
bears aresemblance, direct or indirect, to the way 
language is used in the real world.” (Ellis, 2003, 
p.16, cited in Kumaravadivelu, 2006). 


The key elements of the definition applied to 
the task in this case are: 


° Attention to meaning 

° Engagement with grammar 

° Use of authentic communication 
° Social interaction 
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. Learners making use of their own linguistic 
resources 

. Use of language as it is used in the real 
world. 


Although the learners this task is designed 
for are beginners, integration of these skills is 
considered conducive to use, practice, and sub- 
sequent automatization of the target language, 
factors identified as critical to effective language 
learning by Mitchell (2003) and others. The 
concept of the “contributing student” defined 
by Collis & Moonen (2006) in the technology 
supported learning literature also informed the 
task design. The assumption here is that benefits 
result when learners are involved in development 
of learning support materials for their own, and 
other students’ use. The development process and 
evaluation study findings from the first iteration 
of the beginners’ Italian course are described in 
full detail in Brussino (2002). 

A significant point to emerge from this earlier 
study was that although learners had specifically 
asked for more cultural information to be made 
available to them, they were interacting very little 
with the world of Web resources they had helped to 
design for the purpose. Apart from proving useful 
as areference collection for language structures 
and course administration information, the Web 
site was otherwise underused. While creation of 
the resources was undoubtedly a useful activity 
in a number of respects, it became apparent that 
limiting students’ use of the Web to the simple 
task of accessing information restricted the use of 
a learning tool that held greater potential value. 
There is a growing body of literature that sup- 
ports use of the Web across the disciplines and 
also applies in this context: 


“...to create effective and immersive learning 
environments” (Jonassen, 1995) 


and “to provide efficient and collaborative means 
of communication for students with their teachers, 
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and with each other” (Jonassen, 1995, cited in 
Herrington & Oliver, 2001) 


The challenge perceived in this context is to 
guide the interaction between teachers, learners, 
Internet accessible sources of cultural informa- 
tion and language learning materials in ways that 
support efficient achievement of the specified 
learning objectives. In addition to output targets, 
the objectives include increased learner autonomy, 
interest in, and understanding of the learning 
experience and motivation to continue exploring 
and learning beyond the classroom. These aspects 
serve to promote individual development through 
meaningful interaction in the sense described by 
Warschauer (2002). Use of the Web and Internet 
communications technologies also serves to 
promote the electronic literacies that Shetzer & 
Warschauer (2000) define as essential life skills, 
and that good pedagogy dictates should be in- 
tegrated into the higher education curriculum. 
The aim in this case was for technology tools to 
become invisible or “normalized” as Bax (2003) 
describes this degree of integration. Kern (2006) 
notes that electronic literacies enable new forms 
of discourse as well as new ways to create and 
participate in communities. In the context of 
language classrooms that are geographically 
remote from the native speaker cultural group, 
the opportunities are considerable. 


Articulation of Theoretical Concepts 


The basic but comprehensive principles for effec- 
tive language learning outlined by Mitchell (2003) 
provide the basis of activity design, that is: 


° Rich (i.e., authentic, culturally informative 
and relevant) input with associated interest- 
ing content 

7 Opportunities to use, practice, memorize, 
and automatize, that is, to learn from and 
through experience 

. Contextualized, responsive and reactive 
feedback 
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° Opportunities for reflection 
. Meaningful assessment. 


From this starting point, the proposed solution 
tothe problem of limited use of available materials 
was to introduce into the courses a Web focused 
project designed to allow learners to: 


. Engage with authentic materials 

° Be actively involved in true-to-life situa- 
tions 

° Engage in collaborative activities and be 
encouraged to take risks. 


Herrington and Oliver (2000) define authentic- 
ity as a central characteristic of effective learning 
design. In the context of this task, the use of Web 
sites generated by Italian organizations means 
that language learners have to meet linguistic 
challenges such as understanding practical and 
theoretical information presented in complex 
terminology designed for use by native speakers, 
make sense of it, speak and/or act accordingly. 
This may involve managing discussions with na- 
tive speakers on information retrieved, reflecting 
on its cultural and contextual aspects, rephras- 
ing data, checking for correct interpretation and 
meaning. The project also promotes the ability 
of beginners to manage under such demanding 
circumstances. This was achieved by simulating 
the process in class with the support of the teacher 


and the confidence building aspects of group work 
prior to independent action. 


Structural Design 


The structural design of the project is based upon 
Second Language Acquisition (SLA)/Foreign 
Language Acquisition (FLA) methodology. In 
order to be effective in assisting learners to meet 
the known linguistic challenges, the route through 
to completion of the projectneeds clear signposts. 
Learners are guided step by step through a series 
of complex language learning processes defined 
by the SLA model explained by Long (1996) and 
Gass (1997) among others, and summarized by 
Chapelle (1997; 1998; 2005). This model defines 
the stages of development of the learner’s lin- 
guistic system between input and output shown 
in Table 1. 

Some SLA/FLA research further groups the 
above processes into three clearly defined sets: 


“The first set of processes converts input to in- 
take, where intake is the subset of the input that is 
comprehended and attended to. From intake the 
learner must still develop an acquired system; 
that is, not all intake is automatically fed into the 
acquired system. The processes in the second set 
promote the accommodation of intake and the 
restructuring of the developing linguistic system 


Table 1. Second language acquisition (SLA) process model 


INPUT The target language to which the learner is exposed 

APPERCEPTION The process through which the learner takes note of particular aspects of the input 

COMPREHENSION Semantic comprehension, accomplished through the recognition of isolated lexical 
items and interpretation of non-linguistic cues 

INTAKE Language which has been comprehended and will later be used to develop the 
learners’ linguistic system 

INTEGRATION The process for holding INTAKE in short tem memory or using INTAKE to 
develop the learner’s semantic system 

OUTPUT Language produced by the learner 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


... Finally, since output studies do not show that 
the learners language is a direct reflection of 
acquired competence, a third set of processes 
must be posited to account for certain aspects of 
language production” (Van Patten, 1989). 


The first step of the learning activity therefore 
has to support learner exposure to “compre- 
hensible and meaningful input,” the necessary 
ingredient for language acquisition (Mitchell, 
2003; Van Patten, 1989). This is achieved though 
directing learners to carefully selected Web sites 
that presented content and thematic relevance to 
semantic and language structures that are also 
encountered in class. 

Asking learners to focus on extracting par- 
ticular items of information is the second step 
which aimed at scaffolding the apperception and 
comprehension stages. Scaffolding in this sense 
is designed to provide a cognitive framework 
within which learners can assimilate content and 
begin to structure a knowledge base for a subject 
(Ausubel, 1960; 1978). The third step requires 
attending to the noticed input thus supporting 
the conversion of input into intake. This is sign- 
posted by directing learners to jot down on paper 
in isolated sentences, as they find it on the Web 
sites, relevant information to be reported back to 
their classmates. 

To support the next stage, that is, the integra- 
tion of intake and the reforming of the developing 
linguistic system, in step four the learners are 
directed towards and through the process of re- 
wording the intake, this time using familiarterms 
and language structures previously discussed in 
class. The fifth and final step involves production 
of a report; in other words, finalisation and pre- 
sentation of language output in oral and written 
form. All steps typically require coaching from 
the teacher and further assistance is provided in 
the form of collaboration within study groups. A 
full description of the Internet focused learning 
activity, findings from evaluation studies and 
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subsequent revisions are provided in the follow- 
ing section. 


The Internet Project 


The Internet project was introduced for pilot test- 
ing in the Beginners A and B courses in 2002. 
Without being assessed, learners were asked to 
form groups of 2 or 3 and spend 3 consecutive 
class contact hours in the computer lab complet- 
ing the following task with assistance from their 
teacher. 


Project A- Italian Media, in groups of 2/3 

. 1* hour: Browse the following suggested 
Web sites on Italian media: 

7 www.rai.it 

7 www.mediaset.it 

° www.ansa.it 

. Decide the TV channels you will work on 
(Rai, Mediaset, Ansa). (15 min) 

. Go to the TV channels you decided to work 
on. Write a report to the class on 3 different 
programmes. Explain: TV station (public or 
private?) title of programme, details of day/ 
time of programming, describe programme, 
give your own comment about it.(35 min) 

° 21 hour: Complete the search for material 
and your group composition. 

° 3 hour: Present your work to the class: 
each person in the group presents one pro- 
gramme. 


Project B- Horoscopes, in groups of 2/3 

° 1“hour: Browse the following suggested Web 
sites on Italian horoscopes: http://oroscopo. 
libero.it/ (oroscopi di tutti i tipi), 

. http://www.eurosito.it/oroscopo/index.htm 
(Voroscopo di Euro Sito) 

. http://www.radioitalia.it (oroscopo settima- 
nale, radio Italia) 

° http://it-horoscope.yahoo.com/ (oroscopo del 
giorno e della settimana) 
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° http://www. horoscopi.com/giorno.shtml 
(oroscopo del giorno, settimanale, del mese, 
dell’anno) 

. Choose a star sign (or one for each person 
in the group) you will work on. (15 min) 

. Write a report to the class containing: 
today’s/this week’s horoscope, this month’s 
horoscope, this year’s horoscope for one star 
sign or more, if you wish.(35 min) 

. 2™¢ hour: Complete the search for material 
and your group composition. 

. 3 hour: Present your work to the class: 
each person in the group presents one horo- 
scope. 


Signposting, Scaffolding, Evaluation 


Students are asked to choose between two topics 
closely associated with themes discussed in class 
(A-Italian media, B-horoscopes). The information 
requested is specific, as described above, to avoid 
learners losing their way in the large amounts of 
information provided by the Web sites. An in- 
dication of time to be spent on each task is given 
as a self-management cue, and because it is easy 
for learners to get distracted while exploring Web 
sites. In order to make sure that everyone in the 
group becomes actively involved, each person 
is assigned a task by the group and required to 
present orally one part of the report. 

The following guidelines are provided in 
class. 


. The purpose of this project is to learn 
strategies of language learning as well as 
language itself and cultural material (i.e., 
learn the correct meaning and structure of 
language by taking advantage of the context 
in which it appears, engage in team work, 
acquire cultural information etc.) 

° The following guidelines may assist you to 
complete the project successfully: 


o Structure your project into the three 
categories of information you will 
provide to the rest of the class, so you 
know what to look for. 

o Look for the information in Italian. 

o  Bookmarkthe URLs you visit anduse 
for information, you will need to go 
back to them. 

fo) Jot down the information in Italian, in 
simple sentences. Rephrase any item 
of information in your own words, 
making sure it can be understood by 
everyone in your class. 

o Write out the report in Italian in your 
own words and in cohesive form, 
making sure everyone in your class 
can understand it when you present 
it. 

o Donottry to translate Web sites into 
English orlook at an English version of 
the site. (Doing so will not help develop 
your language learning strategies, 
instead it might represent an obstacle 
to the successful completion of your 
project). 


Following the oral presentation of the report, 
learners reflect upon their learning aloud in 
class, and by answering the following questions 
in written form: 


° Do you consider this project a useful lan- 
guage learning experience? Why? Why 
not? 

. What have you learnt from this project in 
terms of: 

o Cultural information 

Language learning strategies 

Yourself as a language learner 

Language structures and lexicon 

Use of technology 

Groupwork 


Oo 0 0 0 90 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Learner Feedback 2002 


Learners’ feedback was generally favourable 
to this activity, with 91 percent of students who 
completed the evaluation questions identifying it 
as a useful learning experience. 

One of the initial aims of the project was to 
embed language learning in class into the socio- 
cultural context of the target language, and by 
doing so, to increase interest and motivation. 
Although no direct questions about motivation 
were asked, learners pointed out repeatedly that 
this had been a stimulating way to learn both 
language and culture, for example: 


“This was a great exercise, fun, instructive. It 
was very cool to access Italian Web sites, not 
too hard to understand them and the topics were 
great too.” 


“T found the sites really interesting particularly 
the Ansa site I worked on. It’s something I will 
use in the future.” 


“Interesting cultural information.” 
“Found out a lot about Italian culture.” 


“Tt lets us interact with everyday real-life Italian 
and pushes us to use our abilities of the language 
so far.” 


These comments reflect dimensions of motiva- 
tion identified by Keller (1987) and other authors, 
that is, interest, enjoyment, obvious relevance, 
accessibility, and utility. 

Reflecting upon themselves as language learn- 
ers and the strategies engaged, learners offered a 
range of comments on what they had gained from 
this learning experience, touching on the many 
aspects of learning style as defined by Oxford 
(1990). Some referred to attitudes towards the 
target culture, for example: 
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“T learnt to look at Italians in a different way.” 


Other comments related to metacognitive and 
affective techniques for organizing and coping 
with learning, for example: 


“T have learnt to try and not stress as since you 
take yourself slowly through the information you 
start to understand it more easily.” 


“T learnt it’s not too hard to understand.” 


Many referred to the acquisition of cognitive 
or compensation strategies, for example: 


“Tt helps us to focus on what we know.” 


“TlearntI can identify vocabulary similar to other 
languages I learn.” 


“To put things/express phrases in a way that I 
will understand.” 


“IT was able to correctly guess the meaning of 
words because I had an idea of what the context 
was” 


“T practiced looking at and understanding the 
overview rather than trying to work out individual 
words. ” 


“Learnt that it’s better to work out what you do 
know how to say in Italianand than use that rather 
than to try and do aliteral translation from English 
because this often sounds very unnatural.” 


Learners also found the project useful in terms 
of language structure acquisition and lexical gains. 
Interestingly, some pointed out the direct link to 
output in present and future written language 
production, thus indicating that the process of in- 
tegration had indeed taken place, for example: 
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“T learnt how to use bits and manipulate Ital- 
ian.” 


“T learnt some Italian idioms and useful sentence 
structure.” 


“T learnt some new and useful vocab (e.g. Inoltre, 
magari) that I can use in compositions.” 


“T have learnt a bit about constructing a passage 
in Italian and worked on comprehension skills- 
understanding from context.” 


“Tt could definitely help with future work.” 


Those who commented on the use of technol- 
ogy pointed out that its main benefits to language 
learners were practical applications of language, 
provision of up-to-date information and possibili- 
ties for interaction, for example: 


“Technology is very beneficial in showing applica- 
tions of language by giving us access to Italian 
language sites.” 


“Very easy to use the net to access information 
in other languages, using Internet makes the task 
more fun and more interactive.” 


“Useful because of various media used to increase 
active use of the language.” 


“Using computers is good as the info we look at 
is up to date.” 


Finally, most students seemed to find group 
work helpful, as long as it also allowed room for 
individual growth, for example: 


“Tt was enjoyable working in groups.” 
“Tt was good working with people I didn’t know 


before and being able to seek their advice on 
writing, vocab, etc.” 


“Tt really helps to divide work up then come back 
together to discuss and make conclusions, etc.” 


“Better to research individually then put ideas 
together.” 


With this encouraging feedback in mind, the 
teacher’s reflective process identified modifica- 
tions that were considered likely to have a positive 
effect on future cohorts. 


INTEGRATION INTO THE 
ASSESSMENT SYSTEM 


In 2003, learners used the same guidelines, but 
the project themes changed: Group A-Fashion 
designers and Group B-Weather reports. Given 
both the learners’ and the teacher’s satisfaction 
with the learning outcomes of the previous year, 
it was decided to integrate the Internet project 
in the assessment system. A further dimension 
was added with students presenting the report 
first as an oral presentation which counted for 5 
percent of their final grade, then in a revised and 
written form, also worth 5 percent. Two hours of 
class time were allocated to the oral presentation 
of projects. 


Learner Feedback 2003 


Similar to the previous year, in their enthusiasm 
for the learning experience, 86 percent of students 
who completed the questionnaire identified the 
activity as worthwhile in terms of interest, motiva- 
tion and culture learning, for example: 


“The project was awesome. It made learning 
Italian more fun.” 


“The cultural info was interesting.” 


“Tt makes students be more motivated in learning 
a new language.” 
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“T really enjoyed this project as I enjoy finding 
out about other countries and cultures. It was a 
good assignment as it was simple, yet effective in 
assisting my learning of Italian.” 


“Tt sparked a real interest to throw yourself into 
the language.” 


“Picked up vocabulary, instinct and, most im- 
portantly, for a language student, confidence! 
(Because well researched and rather a fun proj- 
ect).” 


Students’ reflection on themselves as language 
learners was more detailed and rather sophisti- 
cated compared to the previous year’s responses, 
suggesting deep awareness of individual learning 
styles and attitudes to learning, for example: 


“T want to use a wider range of materials, more 
aggressively, in my own time.” 


“As a first time learner of language I am still 
finding my strategies.” 


“T have reconfirmed that I enjoy reading com- 
prehension, independent work, and talking to 
myself in the language I’m learning. This works 
for me.” 


Learners were able to identify clearly the 
cognitive and metacognitive strategies used or 
acquired in organizing and coping with learning, 
for example: 


“Names and dates were helpful as a roadmap 
through a text.” 


“Phrases and vocabulary help to decode mate- 
rial.” 


“T learnt I found it easier to digest information 


when it is presented in list form with patterns 
identified.” 
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“Read for meaning first” 


“Guesstimation of words that have Latin-derived 
roots from context” 


“T understood the Web sites because of my knowl- 
edge of other languages.” 


“Read for meaning first” 


“T learnt how a sentence can mean something 
other than its literal interpretation. ” 


“Even though I didn’ get it straight away I learnt 
to predict and guess.” 


It is possible that formalization of the task 
through integration of the project into the as- 
sessment system compelled learners to be more 
deeply introspective and therefore aware of their 
learning preferences. 

When learners reflected upon their acquisition 
of lexical and grammatical items, their com- 
ments indicated a greater attention to language 
structures than in the previous year. Again, some 
pointed out the direct link to output, confirming 
that the process of integration was taking place, 
for example: 


“Seeing words, grammar and syntax (such as when 
to use the definite articles, or compounds such 
as ‘alla,’ ‘nella,’ ‘della,’ etc.) in texts other than 
from the coursebook is good for understanding 
and thus helps my own creativity.” 


“Tt was a very good way to look at, and learn, the 
way Italian is written and the tricks for English 
speakers, especially regarding syntax.” 


“My vocabulary was extended to a degree espe- 
cially when I found key passages of text.” 


“Tt gave me a good idea of the language struc- 
ture and when different tenses are used when 
writing.” 
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“T got to see a lot of the grammar I had learnt 
especially the past tense.” 


“T have learnt a lot about forming sentences.” 


“T built up my vocabulary and learnt about sen- 
tence structure.” 


“Good way of learning lots of vocab” 


The added dimension in 2003 was greater 
emphasis upon the communicative aspect of the 
oral presentation. As their oral performance was 
formally assessed, learners put more effort into 
what turned out to be a varied lesson in language 
and culture to the class as a whole. The standard of 
the presentations was higher than in 2002, which 
is perhaps not surprising given the assessment 
factor. Groups reported enjoyed learning from 
other groups as well as presenting their own 
material, thus confirming the relevance of Col- 
lis & Moonen’s “contributing student” concept, 
for example: 


“Teaches us to speak confidently in front of oth- 
ers without worrying too much about grammar 
but rather concentrating on smoothly flowing 
sentences” 


“Speaking in front of others taught us the ability 
to overcome minor mistakes because we were 
talking about subjects the other students had little 
or no prior knowledge of.” 


“Created more confidence in speaking in Ital- 


* ” 


ian 
“T found it helpful with pronunciation.” 
“When presenting and listening to others at your 


level you become aware of things you didn’t 
know.” 


“A good exercise to improve confidence in speak- 


*. ” 


ing 
“Learnt how to present info to others” 


“T was impressed with the way in which the ma- 
jority of the class was able to present their topic, 
only occasionally looking at their notes.” 


A further improvement on the previous year 
proved to be that learners were much more aware 
of the cultural aspects of the project. Most at- 
tributed the noticing of cultural material specifi- 
cally to the choice of topics, which seemed to be 
more conducive than the ones chosen in 2002, 
for example: 


“Fantastic! The little glimpse Ihave had of Italian 
history and art history [as influence on fashion 
designers] makes me want to study more.” 


“T learnt a lot about a few Italian designers and 
their lives which I found quite interesting.” 


“Learnt about Italian geography” 


“Tt forces you to get straight into Italian culture 
through an Italian’s eyes.” 


“Tt forced us to understand real world Italian 
as well as giving us an insight into what we 
studied. ” 


“V.v. good way of learning a lot of different cultural 
info in such a short amount of time!” 


“As for cultural information, this type of thing is 
great- small pieces of culture from all directions 


lead eventually to an overview!” 


“There was so much information available- not 
only the cultural/historical but also the everyday, 
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up-to-date happenings which really brought home 
the ease with which we could be communicat- 
ing. Some of these Web sites will definitely be 
revisited.” 


Comments on the use of technology pointed 
out further benefits for language learners. Besides 
confirming the benefits identified in 2002, learn- 
ers also noted, for example: 


“Learnt how to navigate through Italian sites.” 
“How to use Italian search engines” 


“T thought it was a good idea to use multimedia 
in the course and given the guidelines we could 
surf productively.” 


“The Internet is the nearest some will get to total 
immersion.” 


“Useful pedagogical tour of the idiosyncrasies of 
an Italian Web site. They are very different from 
English-speaking ones!” 


“Throughout all the searches you learn a lot 
more Italian!” 


In general, learners seemed to have gained 
support and exchanged knowledge profitably 
through group work, for example: 


“T learnt other people’s strengths and weaknesses, 
so we worked well together and assisted each 
other well.” 

“Enjoyed working with my two colleagues and 
also working with members of other groups in 


cafeteria before class.” 


“Good to build on each other’s knowledge” 
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“Good to compare material and helps learn work 
together” 


The learning experience in 2003 proved more 
satisfying and more complex than in the previ- 
ous year. Therefore, the same project structure 
was maintained in 2004. However, a textbook 
change was considered desirable as a series of 
new language textbooks were being developed in 
Italy for teachers of Italian SLA/FLA adopting 
input-processing approaches. The textbook chosen 
for this course changed from Adesso! (Danesi, 
1997), to Progetto Italiano 1 (Magnelli & Marin, 
2003). The project topics were updated to reflect 
new cultural material discussed in class. 


Learner Feedback 2004 


In 2004, 95 percent of learners replied with a 
clear yes to the question: “Do you consider this 
project a useful language learning experience?” 
and then explained why. As in the previous years, 
they identified the activity as worthwhile in terms 
of interest, motivation, independent learning and 
culture learning, for example: 


“T’ve learnt more ways of learning and teaching 
myself.” 


“It made me much more confident in using the 
language.” 


“Tt encourages students to look outside the class- 
room for resources on the subject.” 


“Interactive and hands on learning has effective 
results when learning cultural aspects as well as 
language structure.” 


“T learnt a lot about the culture of Italy.” 


“Tt was great to read through the Web sites, to see 
the best places to visit.” 
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However, one student’s response was: 


“Yes and no. Any opportunity to speak language 
aloud is useful no matter (usually) how painful, 
but the stress of speaking in front of class perhaps 
outweighed the benefit!” 


This served to highlight the level of anxiety 
associated with public speaking, especially when 
linked to assessment, in this case, overwhelming 
any other consideration. Other learners shared 
this anxiety, although some were more positive 
about the experience. One learner summarized 
it in these terms: 


“T found ita very useful language learning experi- 
ence overall as I was forced to research and then 
speak solely in Italian to an audience. Although 
I found this daunting and difficult, it certainly 
helped put the concepts and information taught 
inaclassroom environment into a real life context 
which I found highly valuable.” 


This level of appreciation that learning takes 
place at the edge of ones’ comfort zone may be 
considered uncommonly mature for a first year 
university student. 

In terms of reflection on learning strategies 
used, feedback again echoed previous years’ 
comments, for example: 


“T realised early on that I was destined to fail 
if I tried converting sentences in English into 
Italian.” 


“Starting to actually think in Italian rather than 
trying to translate.” 


“Learnt to pick out the concepts that you un- 
derstand—little phrases, and so on—to try to 
get a better grasp of what the entire Webpage is 
about.” 


“That when you come across a complicated sen- 
tence, you must get the basic understanding and 
then put it in your own words.” 


“To manipulate the Internet to learn to say the 
things I want to say.” 


LEARNER FEEDBACK 2005 AND 
2006 


Although the last three years of this case study 
saw anew textbook adopted and a larger amount 
of cultural material explored in the courses, the 
theoretically supported approach to language 
teaching as well as the structure and integration 
of the Internet project remained unaltered. Itis in- 
teresting to note that the change in textbook andin 


Figure 1. Percentage who found this task a useful language learning experience 
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the content material for subsequent courses appear 
to have made no difference to the student feedback 
regarding the usefulness of this particulartask. As 
Figure 1 demonstrates, learner feedback in 2005 
and 2006 echoed previous years with 89 percent 
of respondents in 2005 and 88 percent in 2006 
answering the question: “Do you consider this 
project a useful language learning experience?” 
with an affirmative statement. 
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REFLECTION ON FIVE YEARS 
FEEDBACK 


When individually reviewed, categories of learner 
comments show encouraging scores over the 
five years. Figures 2-5 present a summary over 
the period. 

Not surprisingly, acquisition of cultural infor- 
mation shows the highest peaks, however all of the 


Figure 2. Percentage agreeing that the task supports acquisition of language learning strategies 
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Figure 3. Percentage agreeing they acquired language learning structures 
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Figure 4. Percentage agreeing they learnt useful cultural information 


% Respondents Who Agreed They Learnt Cultural information 


Figure 5. Percentage of respondents who agreed they learnt useful lexicon 
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categories show scores that point to the efficiency 
of this task in language acquisition. 


CONCLUSION 


This particular language learning task has 
maintained, over a five-year period, a high score 
of student satisfaction with the overall learning 


experience anda highly satisfactory score in each 
of the identified criteria. A combination of factors 
contribute to making this a successful learning 
experience, some generic learning design con- 
siderations, some related to computer facilitated 
learning and others specific to language learning. 
Support for the theoretical approach to teaching 
and learning, to activity design and for integra- 
tion into courses is drawn from three areas of 
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the current literature. The findings of the study 
were analyzed accordingly, and the conclusions 
are presented in the following summary. The 
decision not to consider these areas of literature 
separately in the conclusions reflects the authors’ 
belief that success is attributable to a complex 
interaction of these three distinct elements, and 
that consequently, they cannot realistically be 
separated for the purpose of analysis. 

One of the first principles derived from the 
study is that beginners require appropriate scaf- 
folding to initiate profitable learning habits, in this 
case, to use technology as an integral learning tool, 
that is, as a means to an end rather than as an end 
in itself, to process various types of authentic and 
instructional information, and to progress effec- 
tively in the development of a language system. 
Guidance is also needed in self-management 
strategies suchas limiting the number of Web sites 
visited, using time effectively, and organizing and 
presenting material in various formats. 

Correction of sub-optimal strategies was also 
facilitated as the different approaches learners pur- 
sued became visible throughout the study. It was 
interesting to observe some learners approaching 
the task initially by searching for information 
on Web sites in English, then translating it into 
Italian, thus sidestepping the whole language 
acquisition process. Others attempted totranslate 
Italian material into English, write their report 
in English then translate it back into Italian, the 
result of which is understandably confusing for 
both presenters of the information and for the 
audience. The scaffolding and responsive feed- 
back roles of the teacher therefore play a critical 
role in the success of this activity at beginners’ 
level, and have significant implications for later 
stages of study. Some learner feedback reflected 
unclear goals and insufficient guidance, and oc- 
casional comments such as: “I spent too much 
time surfing,” indicated that even well designed 
instructions and good intentions did not always 
translate into adoption of successful strategies. 
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This highlighted the importance of repetition 
and reinforcement. 

Integrating the Internet focused research and 
presentation project into the course assessment 
appeared to have a positive impact on its benefits 
to learners, although this may have been affected 
by the second iteration of the project being better in 
other ways than the first. Similarly, the integration 
of electronic literacy and generic learning skills 
development into first year courses may serve 
the students well in later years and professional 
life. Study of this could be a useful focus for 
future research. In this study, learners appeared 
to put more effort into their presentation in class, 
producing booklets and overheads, involving oth- 
ers in language and culture learning activities, 
and turning the experience into an informative 
exercise for other learners. The overall standard 
of output was higher and, as student comments 
indicate, more emphasis was placed on com- 
munication. The assessment component placed 
more pressure on the learners to perform well in 
the oral presentation, and comments from 2003 
offered practical suggestions, suchas introducing 
the project earlier in the paper to better balance 
workload, having more time to practice between 
research and presentation and having more time 
to present in class were acted upon. 

Following from this overall positive experi- 
ence, a similar project has since been introduced 
at Intermediate level. Preliminary enquiries into 
the outcomes of the project at later stages indicate 
that learners at intermediate level needed little 
guidance through the project as they had devel- 
oped a degree of autonomy. This might point to 
the value of this activity in developing learner 
independence, a possibility noted by tutors in 
other beginners courses. Some learners seemed 
no longer to need guidance through the processes 
involved, as one student explained: 


“The exercise has made me more confident in my 
ability to self-teach and that my strategy is a good 
basis or tool for future learning.” 
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This study adds to a growing body of evidence 
supporting the case that well conceived use of 
technology can promote effective learning and 
development of effective learning strategies. “Well 
conceived” assumes a basis in sound pedagogical 
design, a generic possibility articulated, in this 
case, through application of established principles 
of second language acquisition and technology 
supported learning. As Egbert (2005) notes, 
multiple theoretical perspectives are important 
in these times of rapid cross cultural expansion, 
social change and technological diversity. The 
pace of change demands continuous innovation, 
reflection, evaluation and revision of learning 
opportunities and environments in order for full 
educational potential to be realized. Hence the 
work described in this chapter will continue to 
evolve as circumstances demand and resources 
permit. 
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KEY TERMS 


Authentic Learning Activities: Study activi- 
ties that incorporate the use of real world infor- 
mation sources, communication tasks, resources 
and/or organizations and that reflect real world (as 
opposed to contrived or artificial) situations. 


Computer Assisted Language Learning 
(CALL): learners learning language in any con- 
text with, through and around computer technolo- 
gies (Egbert, 2005). 


Electronic Literacy: Ability to communicate, 
read, write, compose and conduct research with 
competence and confidence in computer medi- 
ated and Internet environments. (Derived from 
Warschauer 1999 http://ec.hku.hk/macomp/Ses- 
sion_2/electronic_literacy.htm) 


Generic Skills: Skills that may be applied 
to a range of different situations, e.g. Internet 
research skills, self-management skills or learn- 
ing strategies. 


Integrated Learning: The incorporation of 
a range of discrete skills into learning tasks or 
activities that enables achievement of specified 
learning outcomes. 


Internet Project: A project that requires stu- 
dents to use the Internet to communicate, find, 
process and report back on information found on 
external Web sites. 
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Pedagogy: Application of established edu- involves a process of input, apperception, com- 
cational principles to the design and support of prehension, intake, integration and output. 


learning activities for any specific purpose. Svident Feedbacks Comins wierd by 


SLA/FLA: An established theoretical basis students in response to specific questions asked 
for second or foreign language acquisition that about learning tasks, activities or environments 
they have engaged with. 
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Chapter Il 
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Prewriting Conferences on 
Drafts 
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ABSTRACT 


This chapter reports on a comparative study of face-to-face (FTF) and written electronic (WE) confer- 
ences as pre-writing activities in the English as a Second Language (ESL) classroom. Twenty-seven 
intermediate to advanced students participated in the study over a 4 week period. Latent semantic 
analysis and corpus linguistics measures were used to compare the extent to which the first drafts in- 
corporated the terms and ideas introduced during the 2 types of conferences. Although no difference 
was found in the length, or semantic or lexical complexity of first drafts, the results indicated greater 
lexical and semantic similarity between FTF pre-writing conferences and subsequent drafts. In other 
words, students made better use of the terms and ideas introduced during the FTF conferences when 
individually writing first drafts. Reasons why this may have been the case are suggested, and directions 


for further research are offered. 


INTRODUCTION 


Whole-class discussions or class conferences 
are often used in English as a Second Language 
(ESL) writing classrooms to generate language 
and ideas about a topic. This pre-writing stage 


usually is viewed as particularly important for ESL 
writing students who typically have a relatively 
restricted vocabulary. The rationale behind pre- 
writing conferences is that students can use the 
language and ideas generated by group members 
in their subsequent individual writing. 
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This chapter reports on a study that compares 
the length, andthe semantic and lexical complexity 
of first drafts written after two media for pre-writ- 
ing conferences: traditional face-to-face (FTF) 
conferences and written electronic (WE) confer- 
ences. The research questions under investigation 
are (1) “Do both types of pre-writing conferences 
result in first drafts with equivalent textual fea- 
tures?” Moreover, this study compares how well 
ESL students make use of language and ideas 
generated during the two types of conferences 
when individually writing first drafts. Therefore, 
the second research question is (2) “Are both types 
of pre-writing conferences equally beneficial in 
helping students generate language and ideas for 
use in subsequent writing?” 

WE conferences are a useful way to stimulate 
second language students’ active participation, 
language practice, and language learning. Re- 
search has demonstrated that compared to FTF 
conferences, the WE setting leads to participation 
that is more balanced among group members 
(Beauvois, 1998; Chun, 1994; Fitze, 2006; Kern, 
1995; Warschauer, 1996). Students who do not 
participate much in FTF discussions tend to 
participate more in WE conferences (Fitze, 2006; 
Warschauer, 1996). WE conferences tip the bal- 
ance of participation away from the teacher and 
towards the students, allowing students to take 
more control of the discussion (Chun, 1994; Fitze, 
2006; Kern, 1995; Sullivan & Pratt, 1996). More- 
over, ESL students in WE conferences practice 
a wider vocabulary of words related to a writing 
topic (Fitze, 2006); and participate in discussions 
that are of greater lexical complexity than FTF 
discussions (Fitze, 2006; Warschauer, 1996). 
Finally, WE conferences, particularly with both 
native and non-native speaker participants, lead 
to negotiated interactions with a focus on form 
in which the ESL students’ attention is directed 
to discrepancies between their interlanguage and 
the target language. These interactions can have 
a beneficial effect on ESL learners’ lexical and 


syntactic development (Blake, 2000; Lee, 2004; 
Smith, 2003; Toyoda & Harrison, 2002). 

Researchers have begun to explore how par- 
ticipation in WE pre-writing conferences might 
also benefit second language students’ subsequent 
writing. For instance, Sullivan and Pratt (1996), 
Braine (1997, 2001), and Ghaleb (1993) used holis- 
ticinstruments to quantitatively compare the value 
of WE and FTF conferences to students’ first and 
final drafts. Unfortunately, taken together, these 
studies failed to demonstrate a consistent trend of 
effect of pre-writing environment on the quality 
of first drafts. In particular, Brain (1997, 2001) 
and Ghaleb (1993) both reported higher scores 
for first drafts composed after WE conferences. 
In contrast, Sullivan and Pratt (1996) reported 
higher scores for first drafts that followed FTF 
conferences. 

Sullivan and Pratt (1996), Ghaleb (1993), and 
Braine (1997, 2001) assessed the quality of first 
drafts with holistic scales even though holistic 
scales evaluate writing in terms of features 
not normally incorporated into first drafts. For 
instance, holistic scales award higher scores for 
features suchas high level discourse organization, 
and grammatical accuracy and complexity (e.g., 
Educational Testing Service, 2006). However, 
contemporary writing teachers ordinarily instruct 
students writing first drafts merely to get ideas 
on paper and to begin to narrow and organize 
them (Reid, 1993). According to process writ- 
ing theory, when writing first drafts, students 
should primarily be concerned with the inclusion 
of appropriate content and should not be overly 
concerned with grammar or organization (Elbow, 
1973; Reid, 1993; Zamel, 1982, 1983). As aresult, 
one must question if these holistic instruments 
were appropriate for evaluating first drafts; and 
indeed, question any claims that drafts written 
following one type of conference were superior 
to drafts written following the other. 

In light of process writing theory, an analytical 
instrument suitable for assessing the quality of first 
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drafts should focus on the inclusion of content. 
Moreover, since teachers do not expect content 
in first drafts to be particularly well organized 
(Elbow, 1973; Reid, 1993; Zamel, 1982, 1983), the 
measurement of content should be derived from 
the analysis of small bits of discourse such as 
individual sentences or even lexis. Accordingly, 
the current study assesses the content of first drafts 
by analyzing t-units. Because t-units were used 
in this study as a way of dividing writing into 
individual ideas, a psycholinguistic definition of 
the t-unit was required. Accordingly, I used the 
Keep It Simple, Stupid (KISS) definition (Vavra, 
2000), which is based on Hunt’s (1965) original 
conception of the t-unit, with some modifications. 
In practice, the main difference is that while Hunt 
(1965) discarded sentence fragments (i.e., incom- 
plete clauses) and garbles (i.e., incomprehensible 
statements) from analysis, Vavra (2000) retains 
them. According to Vavra (2000), since a frag- 
ment or garble represents a student’s complete 
thought, it constitutes a t-unit. Thus, in this study, 
fragments and garbles produced during the con- 
ferences are counted as t-units. Since the focus 
was on comparing ideas between the conferences 
and drafts, Vavra’s (2000) KISS psycholinguistic 
definition of the t-unit was a perfect fit. On the 
other hand, when t-units were used to assess the 
semantic complexity of drafts (i.e., by measuring 
the length of t-units), Vavra’s (2000) definition was 
also appropriate because it turned out in practice 
to be the same a Hunt’s (1965), since no fragments 
or garbles occurred in the drafts. 

Sullivan and Pratt’s (1996), Ghaleb’s (1993), 
and Braine’s (1997, 2001) methodology assumed, 
in broad terms, that if the drafts composed after, 
for instance, the FTF conferences were better 
than the drafts composed after the WE confer- 
ences, it was because the FTF conferences were 
superior as a pre-writing activity. However, since 
no direct evidence was offered to show that the 
same language and ideas generated in their pre- 
writing conferences were also used in the drafts, 
one cannot know for certain if the drafts were 


22 


better specifically because of what occurred dur- 
ing the pre-writing activities. To know if drafts 
were superior specifically because of some aspect 
of the pre-writing conference, one would need to 
show that the drafts incorporated, or were at least 
inspired by the same superior ideas and language 
introduced in the pre-writing conference. 

Although the current study provides a com- 
parison of the quality of drafts produced after the 
two types of conferences, this does not refer to the 
content quality of drafts. The measures of draft 
quality in this study refer to the textual features of 
drafts. In other words, rather than referring to how 
well the drafts address the topic, the measures of 
draft quality in this study refer to the draft length, 
lexical complexity, and semantic complexity of 
the drafts. See the section on key terms and their 
definitions for clarification of these terms. More- 
over, as shall become clearer, although the textual 
features of drafts are compared, this comparison 
is not used to establish a casual relationship 
concerning the relative benefit of the pre-writing 
conferences on subsequent writing. Instead, this 
analysis is used to determine if students were able 
to produce drafts with equivalent textual features 
following, although not necessarily as a result of, 
the two types of pre-writing conferences. 

In this study, the relative benefit of conferences 
on subsequent writing is evaluated by measur- 
ing the degree to which students used the same 
language and ideas in their drafts that had been 
generated during the pre-writing conferences. 
The underlying assumption here is that the more 
students tended to use the language and ideas 
generated in the conferences, the more benefi- 
cial the conferences were to students’ writing. 
Conversely, if students did not tend to use the 
same language and ideas that were introduced in 
a conference, then the conference must not have 
been very helpful to the writing task. 

Typically, to measure how much of the lan- 
guage and ideas produced in a draft are similar 
to a pre-writing conference, a researcher would 
need to examine each sentence or t-unit in the 
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conference and the draft and look for matching 
information. More generally, such an analytical 
model assumes that the more similar the terms 
and ideas in the draft are to the terms and ideas 
in the conference, the more the conference influ- 
enced the draft. Discovering how many words 
two or more documents have in common can be 
accomplished using a Corpus Linguistics analysis. 
The Corpus linguistics analysis used in this study 
will be described in more detail in the section on 
instrumentation. The matching of ideas between 
two or more documents, however, isaconsiderably 
more problematic matter that has been approached 
in several ways. 

Sentences have been linked semantically to 
each other based on sharing identical or similar 
lexical items. For instance, Hoey (1991) argued 
that when sentences contain a sufficient amount 
of lexical overlap, they tend to be semantically 
related. Hoey (1991) divides lexical overlap into 
simple lexical overlap and complex lexical overlap. 
Simple lexical overlap includes exact word repeti- 
tion as well as variants of the same root word (e.g., 
the same word in noun, adjective, or adverb form: 
happiness, happy, and happily). Complex lexical 
overlap includes synonyms (.g., happy andglad), 
hyponyms (@.g., school and building), phrasal 
definitions (e.g., classroom and the place where 
we have our classes), and referential pronouns. 

Hoey’s (1991) analytical method is not without 
technical hitches. First, cohesive devices, such as 
referential pronouns, must first be replaced by 
the content words to which they refer. This, in 
itself, can become problematic when words such 
as this can be used to replace a large part of the 
preceding sentence. Moreover, particularly in the 
context of second language writing, this method 
requires a good deal of subjective analysis when 
deciding which lexical items should be linked. 
Furthermore, in a study like this one, wherein a 
large number of texts are subjected to analysis, 
matching information this way would be im- 
mensely time consuming. Indeed, research using 
this sort of lexical cohesion analysis has typically 


used a rather limited number of very short texts 
(e.g., Reynolds, 2001). 

The primary disadvantage of Hoey’s method 
of comparing texts is that the technique requires 
subjective judgement and is not feasible for 
analysing large amounts of text. However, the 
primary advantage is that textual comparisons 
are based on semantic similarity rather than 
only on exact lexical repetition. To overcome 
the disadvantage while preserving the advantage 
of Hoey’s approach, this study made use of an 
automated semantic matching technique called 
Latent Semantic Analysis (LSA) (Laundauer & 
Dumais, 1997). LSA is a corpus-based statisti- 
cal model of word usage that allows researchers 
to make comparisons of semantic similarity 
between pieces of textual information. LSA is 
used in this study to match the semantic content 
of conferences and subsequent first drafts. See 
Yu, Cuadrado, Ceglowski, and Payne (2002), 
and Laundauer and Dumais (1997) for excellent 
qualitative overviews of LSA. More details about 
how LSA was used in this study are provided in 
the section on instrumentation. 

This review of the literature has led to two 
important research questions. First, do the tex- 
tual features of drafts written after FTF and WE 
conferences differ? More specifically, is there a 
difference in terms of the total length, semantic 
complexity, or lexical complexity of drafts writ- 
ten after the two types of conferences? These 
measures will reveal if students were able to 
produce drafts with equivalent textual features 
following although not necessarily as a result of, 
the two types of pre-writing conferences. Second, 
to what degree can the language and ideas in the 
drafts be tracked back to their earlier appearance 
in the conferences? Corpus linguistics and LSA 
measures will be used to find out if both types of 
conferences were equally beneficial to students’ 
subsequent writing. As discussed, rather than 
being based on the premise that better drafts 
reflect better conferences; this study proceeds 
under the assumption that the more similar the 
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language and ideas used in the drafts are to the 
language and ideas introduced inthe conferences, 
the more useful the pre-writing conferences are 
to students’ writing. 


RESEARCH METHODOLOGY, 
PARTICIPANTS, AND PROCEDURES 


This study took place over a four-week period of 
a 14-week Intensive English Language Program 
(IELP). The period of the study, chosen in consul- 
tation with the classroom teachers, involved the 
ninth, tenth, twelfth and thirteenth week of the 
program during which the two classes alternated 
between FTF and WE settings. During weeks 
nine and 12, class A was in the WE setting while 
class B was in the FTF setting. Weeks 10 and 13 
engaged class A inthe FTF setting, withclass B in 
the WE setting. This counterbalanced design was 
used to avoid “group” as a confounding variable 
in comparisons across conference settings. 

The 27 student participants in this study were 
high intermediate to advanced ESL students in 
a mid-sized North American university. The 
students, who were assigned to two classes (A 
and B) by the administration of the IELP and had 
average Michigan Test scores of 68.72 to 68.50 at 
the beginning of the term in which the study was 
conducted. The two classes were also approxi- 
mately balanced in terms of number of students 
(14 and 13 respectively), gender, native language 
background, and cultural background. 

The topics used in this study were new to the 
students, within the context of this course, at the 
beginning of each conference (see Appendix A 
in Fitze, 2006 for information about the topics). 
The students participated in the pre-writing and 
drafting sessions as part of their regular writing 
class requirements. FTF and WE conferences 
were held in the students’ regular classroom or 
computer lab respectively. The latter provided 
access to WebCT, which was used for the WE 
conferences. 
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To ensure that both class groups would have 
a similar understanding of the importance of 
their participation; students were informed that 
submitting drafts for this study would count to- 
wards the homework portion of their mark and 
that the first drafts would need to be developed 
into final drafts which would count towards 
their final mark in the course. Furthermore, to 
be certain that students in both classes would be 
prepared to use the WE conferencing software, 
before data collection began, each class group was 
taken into the computer lab for an introductory 
training session. During these sessions, students 
learned how to log in and out of the system and 
a short rehearsal conference was held. Finally, 
to ensure that all conference groups would be 
equally prepared to discuss each of the assigned 
topics, on the day before each of the pre-writing 
conferences, a written copy of the writing topic for 
the week was provided by the classroom teacher. 
The teacher reviewed the topic with the class to 
ensure that students understood the vocabulary 
and general meaning and reminded students that 
on the following day, they would be required to 
discuss the issue for approximately 20 minutes, 
after which they would have about 25 minutes to 
individually begin writing a first draft that would 
be due for homework on the following day. 

Although teachers were assigned by the ad- 
ministration to teach the students in each of the 
two classes, the author arranged to teach the two 
classes during the four weeks during which data 
were collected. It seemed important to have one 
teacher teach both classes in both environments 
to avoid differences that might arise due to dif- 
ferent teaching styles. For instance, Yagelski 
& Grabill (1998) argued that different teachers 
have different styles of leading WE class discus- 
sions depending on factors such as their level of 
computer proficiency and their attitude towards 
the use of computers in teaching. If the regular 
classroom teachers had lead the conferences, any 
differences in their styles may have introduced 
uncontrolled variability into the study. By having 
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only one teacher lead all the conference groups, 
this variability was removed. 

Throughout the portion of the term preced- 
ing this study, students had already become 
accustomed to using small-group and pair-work 
FTF pre-writing discussions to generate ideas for 
writing. Suchdiscussions are widely used in IELP 
writing classes because pre-writing activities 
such as pre-writing discussions are an integral 
part of the process approach to writing pedagogy 
employed in the IELP. As a result of students’ 
familiarity with using discussions to generate 
ideas for writing, in addition to their familiarity 
with the use of computer conferencing software 
gained as aresult of the training sessions, students 
were adequately prepared to engage in and make 
constructive use of the WE and FTF pre-writing 
conferences. 


INSTRUMENTATION 


This study aimed at detecting differences between 
FTFand WE conferences as pre-writing activities. 
As such, the key independent variable was the 
conference setting. This section discusses the way 
in which the dependent variables were operational- 
ized as measures and is organized with reference 
to the two research questions identified. 

To find out if there was a difference in the 
length of drafts written after FTF and WE con- 
ferences, the number of words in students’ drafts 
was used to make comparisons across conference 
settings. Similarly, the syntactic complexity and 
lexical complexity of drafts were compared across 
conference settings by calculating, respectively, 
the mean length of draft t-units (i.e., in number 
of words), and the standardized type-token ratios 
of drafts. Since the shortest draft collected in this 
study was 90 words, the basis for the standardized 
ratio was 50 words. Fora good description of how 
standardized type-token ratios are calculated see 
Scott (2006). 


To explore the second research question, two 
measures were used. First, the measure average 
maximum cosine, derived from LSA, was used to 
gauge the semantic relationship of students’ drafts 
to the conferences and ultimately to determine if 
there was a difference in how semantically related 
drafts were to the two types of pre-writing con- 
ference. To make comparisons of semantic simi- 
larity, LSA assigns documents (e.g., sentences, 
paragraphs, or other chunks of text) vectors in 
a semantic space. The direction of a vector in a 
semantic space is a mathematical representation 
of the semantic content of the document. A co- 
sine is literally the mathematical cosine between 
the document vectors being compared, although 
cosines in LSA generally vary between 0 and 1 
(i.e., rather than between -1 and 1). If the cosine 
is closer to 1, the documents are more similar, 
while cosines closer to 0 signify semantically 
dissimilar documents. Please see the section on 
key terms and their definitions for clarification 
of the terms used in this paragraph. 

An example will help clarify. Foltz, Britt, and 
Perfetti (1994) used LSA to determine where stu- 
dent writers had found information forsummaries 
about the construction of the Panama Canal. In 
preparation for writing, students read 21 texts that 
included excerpts from textbooks, historians’ and 
participants’ accounts, and primary documents 
suchas treaties and telegrams. To determine where 
the information that students wrote had come 
from, LSA was used to compare the sentences that 
students wrote with the sentences that students 
had initially read, to see which were most similar. 
To do so, each sentence in each student’s paper 
and each sentence in the reading materials was 
first assigned a vector. Next, every sentence in 
each student’s paper was compared with every 
sentence in the readings by computing cosines 
between the sentence vectors. For instance, the 
sentences, “The history of the Panama Canal 
goes back to the sixteenth century” and “Plans 
for the construction of the Panama Canal began 
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in the sixteenth century” obtain a cosine of 0.66. 
In contrast, the sentences, “The history of the 
Panama Canal goes back to the sixteenth century” 
and “Various surveys showed that only tworoutes 
were practical” obtain a cosine of 0.06. These 
example cosine comparisons were made in the 
tasaALL semantic space used in this study. The 
higher cosine between the first two sentences 
in the example above indicates more semantic 
similarity. Foltz et al. (1994) were able to find the 
sentence in the readings which was most like any 
student sentence by knowing which vector com- 
parison yielded the highest, or maximum, cosine. 
Although Foltz et al. did not do so in their 1994 
study, one can easily imagine that having found 
the maximum cosines for all the sentences in a 
student’s essay, they could have taken the aver- 
age of these maximum cosines to yield a single 
score for the student paper, arriving at an average 
maximum cosine. This score would represent how 
closely, on average, a student’s sentences were 
related to the sentences in the readings (Foltz, 
Gilliam, & Kendall, 2000). 

In the context of this study, an average maxi- 
mum cosine is equal to the sum of the maximum 
cosines of astudent’s draft t-units to the conference 
t-units divided by the total number of draft t-units 
the student wrote. A draft with a high average 
maximum cosine is one in which each draft t-unit 
repeats or paraphrases one of the conference t- 
units. A draft with alow average maximum cosine 
is one that does not tend to rely much on what was 
introduced in the conference. Such a draft need 
not be of low content quality or off-topic. A low 
average Maximum cosine merely indicates that 
the writer did not tend to use the ideas presented 
in the conference when writing. 

To assess and compare the lexical similarity of 
drafts with the conferences, key-word analysis us- 
ing Wordsmith Tools (Scott, 2006) was employed. 
The main difference between this measure and 
the LSA measure is that while the LSA measure 
can detect semantic overlap when words are not 
identical, this measure is only sensitive to similar- 
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ity based on exact vocabulary overlap. To obtain 
this measure, first, Wordsmith Tools was used 
to create wordlists for the conference and drafts. 
Next, the wordlists were compared to see which 
words used in each draft were not used in the 
conference preceding it. The ratio of total words 
in the draft over new words used in the draft but 
not used in the conference was then calculated. A 
higher ratio indicates more exact lexical overlap 
between a draft and conference. 


METHODOLOGICAL ASSUMPTIONS 
AND LIMITATIONS 


Twenty-seven intermediate to advanced ESL stu- 
dents were involved in the study, and observations 
were made for a total of eight conferences (i.e., 
four FTF, and four WE) over four weeks. A total 
of 68 drafts were collected and analysed. The 
results of this study were expected to provide a 
picture of the differentiating effect of conference 
setting on drafts for the two groups of students 
involved. The results of this study were expected 
to be applicable to similar groups of students 
studying under similar conditions. 

The only independent variable of interest was 
conference setting, and as discussed, several steps 
were taken to reduce or eliminate any possible 
confounding variables. Other possible threats to 
internal validity include a practice effect, an obser- 
vation effect, and a topic effect. A practice effect 
was predicted: As participants gained experience 
participating in conferences and writing drafts, 
their skill was predicted to improve. Moreover, 
since students were aware that they were being 
observed during the conferences and that their 
drafts were being collected as part of a research 
study, this awareness was expected to result in 
an observation effect (¢.g., students might feel 
more shy or inhibited, or work harder to please 
the researcher). Finally, since students discussed 
and wrote about various topics that may have been 
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more or less motivating for them, a topic effect 
was predicted. 

While the practice effect was expected to 
increase over the four weeks of the study, the 
observation effect was expected to decrease due 
to students’ increased familiarity and perhaps 
comfort with the experimental conditions. How- 
ever, since comparisons were only made across 
classes and conference settings for the same 
weeks and topics, these effects should have had 
an equivalent impact during each week of the 
study and no adverse impact on the validity of 
comparisons. Similarly, since each topic was likely 
equally motivating or less motivating, on average, 
to both groups of students, any topic effect should 
not have had an adverse effect on the validity of 
the comparisons across conference settings for 
the same week and topic. 

Reports of validity for LSA offered in the 
Humanities and Social Sciences literature have 
principally been empirical. In general, valid- 
ity is established by comparing the results of 
LSA semantic matching to similar judgements 
by human raters (e.g. Butcher & Kintsch, 2001; 
Foltz, et al., 2000). Because the validity of LSA 
has typically been established empirically by 
comparison with human graders, the validity of 
LSA measures can be seen as tied to inter-rater 
reliability. For instance, LSA has been used to 


grade student papers (Foltz et al., 2000). These 
judgements of writing quality made by LSA were 
then compared to judgements by expert human 
raters, and Inter-rater reliability scores achieved 
by LSA were as high or higher than those achieved 
by human raters. Because LSA is as reliable or 
more reliable than human graders, it is inferred 
to be measuring the same thing as human graders 
and therefore valid for the intended purpose. 

To allow the reader to assess the validity of the 
LSA comparisons made in this study, Appendix 
A shows excerpts from student drafts matched to 
the conference statements with which they reached 
the maximum cosine. The tasaAll semantic space 
used for the LSA comparisons in this study was 
quite general. Information about the tasaAll se- 
mantic space can be found in Appendix B. The 
sensitivity of LSA comparisons could be improved 
in future studies by constructing semantic spaces 
more specifically related to each of the discussion 
and writing topics. However, as Appendix A re- 
veals, LSA was still able to match the semantic 
content of conference and draft t-units by means 
of the general semantic space used. 


Table 1. Comparison of draft textual features across conference settings 


Setting aoe T-unit length (words/t-unit) Standardized type-token ratio 
WE 242.85 13.83 79.19 
Week? [ete 287.10 (0.66 80.56 
WE 439.33 14.72 78.87 
Week2 Ere 502.25 14.59 79.06 
WE 271.86 1677 78.55 
Week3 (are 380.25 14.04 78.85 
WE 386.50 12.90 78.29 
Week? [pip 230.75 13.13 77.28 
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COMPARISONS OF DRAFT 
TEXTUAL FEATURES 


Did students produced drafts that were longer, 
have longer t-units, or display more lexical 
repetition after one of the two types of confer- 
ences? To determine if there was a statistically 
significant difference across conference settings 
for these measures, independent-sample ¢ tests 
were used. The tests were two-tailed because no 
a priori prediction was made about which drafts 
composed after which conference setting might 
have ahigher mean for these measures. The means 
are presented in Table 1. 

The ¢ tests revealed no statistically significant 
difference (i.e., at p < 0.05; two tailed) for these 
measures across conference settings for any of the 
weeks in the study. This suggests that conference 
setting has no systematic differentiating influence 
on the length, the number of words per t-unit, or 
the type-token ratios of drafts. 


THE SEMANTIC AND LEXICAL 
SIMILARITY OF CONFERENCES 
AND DRAFTS 


Were the drafts written after both conference 
settings equivalent in terms of their lexical and 
semantic relation to the conferences? To investi- 
gate this research question, independent-sample t 
tests were run on the data collected in each week 
of the study across conference settings for draft 
average maximum cosine and ratio total words to 
new words. Again, two-tailed probability levels 
were used because no apriori prediction was made 
about the possible direction of effect. The means 
for these measures are presented in Table 2. 

Table 2 shows that the t tests for average 
maximum cosine revealed a statistically signifi- 
cant difference only for week four. These results 
provide little formal statistical evidence to suggest 
that drafts written after one type of conference 
were consistently more related to the conference 
than drafts written after the other. A plot of the 
means for both classes and conference settings 
by week is presented in Figure 1. Figure 1 shows 
that for three out of four weeks, the means were 
higher in the FTF setting. 


Table 2. Comparison of the similarity of drafts to conferences across conference settings 


: : : Ratio total words to new 
Setting Average maximum cosine 
words 
WE 0.468 3.266 
Wert FIF 0.513 4.710* 
WE 0.617 6.560 
wee FIF 0.606 5.361 
WE 0.583 4.770 
Meee FIF 0.619 6.700* 
WE 0.601 5.280 
vee FIF 0.668** 5.670 


*p < 0.05 (two-tailed); **p < 0.001 (two-tailed) 
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drafts composed after the WE conferences did. 
A plot of the means for ratio total words to new 
words for both classes and settings is presented 
in Figure 2. Figure 2 reveals that for three out of 
four weeks, the means were higher in the FTF 
setting. 

In sum, for both measures discussed in this 
section, the means were higher in the FTF setting 
three out of four weeks. Furthermore, for average 
maximum cosine, the higher means in the FTF 
setting were statistically significantly higher one 
out of three times. Moreover, for ratio total words 
to new words, the higher means in the FTF setting 
were the statistically significantly higher two out 
of three times. Considering both these measures, 
modest evidence suggests that the drafts written 
after FTF conferences were more semantically 
and lexically related to the conferences than drafts 
written after the WE conferences. 


CONCLUSIONS AND IMPLICATIONS 


The results of this study suggest that there was 
no difference in students’ ability to write first 
drafts of equivalent length, semantic complexity, 
or lexical complexity following participation in 
FTF and WE pre-writing conferences. However, 
as has been argued, this result alone cannot be 
used to claim that both types of conferences were 
equally beneficial to students’ subsequent writing. 
This result does suggest that if one type of confer- 
ence was superior to the other as a pre-writing 
activity, students must have been quite skilled at 
compensating for this by coming up with their 
own ideas and composing drafts of equivalent 
textual features in spite of what happened in the 
pre-writing conferences. Indeed, the results of 
this study suggest that students did in fact display 
this skill. Even though there was no difference in 
the textual features of drafts composed after the 
two types of conferences, moderate evidence was 
found to suggest that students were better able to 
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use the terms and ideas generated in FTF confer- 
ences when composing subsequent drafts. 

Perhaps this was caused by differences in the 
nature of interaction in the two different settings. 
In a FTF conference, participants need to take 
temporally sequential turns; that is, while one 
participant is speaking, all the other participants 
are presumably listening. Whatever is contrib- 
uted by the participant holding the floor becomes 
salient to the other participants. In contrast, 
in WE conferences, since participants cannot 
“see” or “hear” each other, it is very likely that 
they will “interrupt” each other, resulting in a 
conversation composed of interleaved multiple 
parallel threads (Simpson, 2005; Smith, 2003). 
For example, a participant may not become aware 
of the most recent contribution or respond appro- 
priately to it, because at the time he or she was 
busy composing a message related to a different 
conversational thread. This means that not all 
participants necessarily become aware of all the 
contributions made during the WE conference or 
even become aware of the main thrust of all the 
conversational threads. Depending on the pace 
of messages appearing on the screen, participants 
may never have the chance to go back to review 
the missed communications. 

Perhaps the students were less able to make use 
of the terms and ideas introduced during the WE 
conferences because they did not become aware 
of them, and as aresult, when writing their drafts, 
needed to strike out on their own using terms and 
ideas that had not been discussed during the pre- 
writing conference. This situation may have been 
exacerbated by the relatively large conference 
groups used in this study. A future study may 
investigate if smaller groups would slow the pace 
of messages appearing on the screen, resulting in 
a greater ability of participants to attend to and, 
ultimately, make use of all the messages. 

Although smaller groups may be desired to 
slow the pace of WE conferences, future stud- 
ies may also investigate the possible advantages 
of using larger conference groups. Pre-writing 
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conferences are beneficial to ESL students to 
the extent that they facilitate communication 
and collaboration about terms and ideas that can 
be transferred to subsequent individual writing 
(Hayes & Flower, 1986; Zamel, 1983). Moreover, 
collaboration is desired because it positively influ- 
ences the number and quality of ideas generated 
by groups (Pendergast & Hayne, 1999). Perhaps 
larger conference groups would give students ac- 
cess to a wider range of expertise to draw upon in 
preparation for writing, resulting in conferences 
and drafts of superior content quality. 

Future research may also make use of a 
control group (i.e., a group that composes first 
drafts without first participating in any pre-writ- 
ing conference), to discover if students would 
compose drafts of equivalent content quality or 
textual features without first participating in any 
pre-writing conference at all. Moreover, research 
might investigate if different sorts of topics may 
mediate differences in the content quality or 
textual features of drafts written by students who 
do or do not attend pre-writing conferences or 
who participate in various types of pre-writing 
conferences. 

Inconclusion, theory regarding the influence of 
pre-writing discussions on subsequent writing is 
an area in need of further research. In the future, 
assessment of the degree to which the words and 
ideas used in students’ drafts actually come from 
the pre-writing conference, in conjunction with 
assessment of the quality of those ideas, will 
make it possible to generate a more complete 
theoretical understanding of how various types 
and configurations of pre-writing environments 
can benefit students’ writing. 
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KEY TERMS 


Average Maximum Cosine: The sum of the 
maximum cosines that the draft t-units contributed 
by a student reached with the conference t-units 
that preceded it, divided by the total number of 
draft t-units contributed by that student. 


Corpus Linguistics: Refers to the application 
of computer technology to linguistic analysis. For 
instance, the computer application Wordsmith 
Tools allows users to list the words in adocument, 
and find the key words in a document. 


Cosine: Refers to a way of measuring the 
semantic similarity between two documents as 
part of LSA. If the cosine between the vector 
representations of two documents is close to 1, 
the documents are semantically similar. If the 
cosine between the vector representations of 
two documents is close to 0, the documents are 
semantically dissimilar. 


Document Vector: Refers, in LSA, to amath- 
ematical representation of the semantic content 
of a document. 


Draft Content Quality: An assessment of 
the content of a piece of writing. For example, an 
argumentative essay has good content quality if 
it addresses the key points at issue and ends up 
presenting a cogent and convincing argument. 


Draft Textual Features: In this study, refers 
to 1) the overall length of a draft in number of 
words; 2) the average length of a draft’s t-units in 
number of words (i.e. as ameasure of the semantic 
complexity); and 3) the standardized type-token 
ratio of a draft (i.e. as a measure of the lexical 
complexity). 


Draft Quality: The textual features of drafts. 
In this study, draft quality does not refer to the 
content quality, organization, or other holistic 
assessment of the quality of drafts. 


Face-to-Face (FTF) Conferences: Class 
discussions that take place in the oral/aural mode, 
in which participants engage in a whole-class 
discussion while being present together in the 
same room. 


Semantic Space: Refers, in LSA, to a multi- 
dimensional space in which the semantic content 
of documents can be plotted and compared. 


Written Electronic (WE) Conferences: Pre- 
writing conferences in which participants discuss 
a writing topic by typing messages that can be 
viewed by all other participants while each par- 
ticipant is seated at his or her own computer in a 
computer laboratory. A WE conference is a type 
of computer-mediated communication (CMC). 
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APPENDIX A during the second week of the study. Draft t-units 
that reached a cosine with a conference statement 
Example of LSA Semantic Matching of at least 0.65 have been selected at random. To 
the left of each draft t-unit is the conference t-unit 
The following excerpt comes from the FTF con- that had the highest cosine with it. 


ference transcript and drafts created by class B 


Conference T-Unit Draft T-Unit 


ok for example their children have but for the different appearance 
possibility to hurt from other children | children receive hurt 
because of the different appearance 


you just have to communicate with and you can’t communicate with 
your partner your partner deeply 

cross cultural marriage has the same cultural marriages and cross 
same opportunity to be successful cultural marriages are same 

as marriages with same culture 

background 

what are you opinion about can if you want to marry which one will 
a cross cultural marriage be as you choose cross cultural marriage or 
successful as a marriage of people same culture marriage 

from the same culture 


maybe there’s benefit from cross there’s benefit of cross cultural 
culture marriage marriage 
to educate the children that do not the children never hate one’s 


shame yourself appearance and never receive 
bullying from other children 


they must think about their children their children might be abused 
welfare 


children from cross cultural also their children have two kinds of 
marriages have the advantage culture and language 

to domain at least two different 

languages 
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APPENDIX B 
The Use of Latent Semantic Analysis 


The Web site at the University of Colorado at 
Boulder (http://Isa.colorado.edu/) was used to 
carry out the Latent Semantic Analysis used in 
this study. To compute cosines, an appropriate 
semantic space within which to conduct the 
analysis must first be chosen. The semantic space 
used in this study was “General reading up to 
first year college,” also referred to as tasaALL. 
The following is an extract taken from the Web 
site that explains the composition of the tasaALL 
semantic space. 

This space uses a variety of texts, novels, 
newspaper articles, and other information, from 
the TASA (Touchstone Applied Science Associ- 
ates, Inc.) corpus used to develop The Educator’s 


Following are the specifics for each space: 


Word Frequency Guide. This first incarnation of 
TASA-based spaces breaks out by grade level 
—there are spaces for 3rd, 6th, 9th and 12th grades 
plus one for “college” level. These are cumulative 
spaces, that is, the 6th grade space includes all 
the 3rd grade docs, the 9th grade space includes 
the 6th and 3rd, and so on. 

The judgment for inclusion in a grade level 
space comes from a readability score (DRP-De- 
grees of Reading Power Scale) assigned by TASA 
to each sample. DRP scores in the TASA corpus 
range from about 30 to about 73. TASA studies 
determined what ranges of difficulty are being 
used in different grade levels (e.g., the texts used 
in 3rd grade classes range from 45-51 DRP units). 
For the LSA spaces, all documents less than or 
equal tothe maximum DRP score for a grade level 
are included (e.g., the 3rd grade corpus includes 
all text samples that score < 51 DRP units). 


name grade maxDRP #docs #terms #dims 
Tasa03 3 51 6,974 29,315 432 
Tasa06 6 59 17,949 55,105 412 
Tasa09 9 62 22,211 63,582 407 
Tasa12 12 67 28,882 76,132 412 
tasaALL college 73 37,651 92,409 419 
The breakdown for samples by academic area (in tasaALL): 
samples paragraphs 

LanguageArts 16,044 57,106 

Health 1,359 3,396 

HomeEconomics 283 403 

Industrial Arts 142 462 

Science 5,356 15,569 

SocialStudies 10,501 29,280 

Business 1079 4834 

Miscellaneous 675 2272 

Unmarked 2,212 6,305 

Total 37,651 119,627 
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ABSTRACT 


This chapter discusses the use of blogging in a beginning level academic writing course. Blogging 
was used in this writing course both as a means of interacting with the other students and as a means 
of discussing the issues the students were to write about in their classroom assignments, all of which 
dealt with issues related to the nature of plagiarism and what policies towards plagiarism should the 
university adopt. The chapter analyzes the blogs of an African immigrant student. It is argued that the 
use of blogs allows the students to develop a variety of rhetorical strategies outside the confines of the 
course that could then be transferred into the student’s academic writing assignments. 


INTRODUCTION 


Blogs have become one of the most widely used 
forms of computer-mediated communication 
(CMC), perhaps because of the relative ease 
with which they can be used to publish ideas, 
opinions, personal experiences, or responses on 
line. With the of various technologies, ranging 
from traditional forms of hyperlinking to blog 


rolls, RSS feeds, and aggregators, blogging has 
become anetwork of what Weinberger (2003) has 
called “small pieces loosely conjoined.” Com- 
position teachers have begun to recognize their 
importance in the writing classroom. Lowe and 
Williams (2004) argue that “weblogs can facilitate 
a collaborative, social process of meaning mak- 
ing (Para. 16)”. 
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Blogs differ from other forms of computer- 
mediated communication in a variety of ways. 
The most important for the L2 composition 
teacher may be in how they can create different 
types of relationship between the writer and the 
reader than may be found with other forms of 
CMC. The nature of authorship has become one 
of the most controversial in blogging. While the 
Internet has often been thought to decenter the 
role of the author (Bolter, 1991), blogs have often 
made the author the center of attention. Listservs 
and Usenet groups often resemble the e-mail upon 
which communication is based. As a result, mes- 
sages seem to be shorter and more hastily written. 
Hypertext tends to deemphasize the role of the 
author by giving the reader greater control over 
how a Web page is read. WebPages also tend to be 
topic-centered, sometimes anonymously written 
and often infrequently updated. 

The focus on authorship can affect the purposes 
for which blogs can be used. Unlike traditional 
Web pages or listservs, which are usually orga- 
nized around atopic, blogging communities have 
been formed primarily around the author or group 
of authors (Shirkey, 2003). The most prominent 
and frequently read bloggers, who reside on what 
Shirkey calls the high end of the “long tail” (An- 
derson, 2006), often become highly identifiable 
on the Internet. Even those blogs on the low end, 
who may have a very small readership, can make 
important contributions to the overall development 
of what is called the blogosphere by allowing 
authors an easy way to express themselves and 
their audience to respond. 

There are also specific features of the architec- 
ture of blogs that allow blogs to be used in different 
ways than other forms of online discourse. Blogs 
can be easily updated, which allow the writers 
to publish their ideas as often they want to. The 
permanence of a blog can give the reader many 
opportunities to return to the blog when it has 
been updated and to read new posts or reread old 
ones. Compared with, for example, listservs, this 
permanence makes blogs seem more like texts that 


students can publish, share, and use fora variety of 
different pedagogical purposes (Bloch & Crosby, 
2006). Thus, they can be a useful technology for 
creating discussions in the classroom. 

The evolution of this role of authorship means 
that the use of blogs in a composition classroom 
may differ from the use of other forms of CMC. 
Pedagogical decisions regarding having indi- 
vidual students create their own blogs or having 
a group of students or a class create a blog can 
impact on their nature as a writing environment 
(c.f. Farmer, 2005). 

For all these reasons, the evolution of blog- 
ging has been one of the foremost factors in re- 
conceptualizing how individuals can participate 
in publishing information of the Internet, what 
Berners-Lee (2000) has called the read/write 
Web or what is often called Web 2.0 (O’Reilley, 
2005). Regardless of what form of blogging is 
used, the specific decisions a teacher makes in 
the implementation will go a long way in affect- 
ing the nature of classroom writing which raises 
many questions teachers need to consider in how 
blogs are used. What types of assignments are the 
blogs used for? Are they used for generating ideas 
for classroom-based assignments or are they used 
as texts in themselves? Are they corrected and 
graded? How does the use of a technology vary 
according to different types of users? 

The sheer number and complexity of these 
questions can make the use of blogging in one 
writing environment and with one type of stu- 
dent difficult to generalize into another writing 
environment with different types of students. 
Therefore it is important to examine the uses of 
blogging ina variety of contexts using a variety of 
types of implementation, as well as with students 
of different linguistic and cultural backgrounds, 
in order to better understand the pedagogical 
potential of blogging. Our primary concern in 
this paper is on two critical areas: how blogs can 
be integrated with traditional types of classroom 
assignments and how they can be used with a 
particularly group of students, in this case an East 
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African immigrant. This paper discusses how 
blogs were implemented in an L2 composition 
classroom and how this student used her blogs 
to develop her ideas and rhetorical strategies 
for use in a beginning level academic writing 
classroom. 


THE CONTEXT FOR 
IMPLEMENTING BLOGGING IN AN 
L2 COMPOSITION CLASSROOM 


Itis often useful to think about the implementation 
of a technology as a response to a pedagogical 
problem. The problem that we had identified was 
that our growing East African student popula- 
tion, many of them recent refugees, were having 
a great deal of trouble with the type of academic 
writing assignments they had been given in their 
composition courses. These immigrant students 
are often referred to as Generation 1.5. Many 
of them had immigrated to the United States as 
teenagers and spent time in the American school 
system before entering college. They, therefore, 
had more exposure to English and American cul- 
ture than our international students and therefore 
bring different strengths and weaknesses, as well 
as learning styles, to the classroom (Blanton, 
2005; Harklau, Loesey, & Siegal, 1999; Reid, 
1997; Roberge, 2002). 

Research in L2 composition has used the term 
“Generation 1.5” to distinguish these students 
from international students who may have less 
exposure to American culture. Their literacy 
development may be similar or different to the 
traditional students depending on a variety of 
factors. One of the most critical factors that has 
been identified is the student’s overall literacy 
development in both first and second languages. 
In Blanton’s (2005) study of an Ethiopian immi- 
grant, she found that the student did not have the 
same level of literacy skills as did other students 
in part because of the “interrupted” nature of 
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her schooling in her first language. When faced 
with the demands of academic writing in the 
university, Blanton (2005) found that this student 
faced tremendous difficulties. Our experiences 
with East African generation 1.5 students had 
raised similar concerns, which led us to consider 
whether blogging could provide these students 
with alternative writing environments where they 
may be able to better exploit their predominately 
oral forms of language. 

Blogging had been primarily used in our class- 
room for students to develop their ideas for their 
classroom assignments throughout the course as 
well as a means of publishing their writing so that 
everyone in the class could read and utilize their 
ideas. In this beginning level academic writing 
course, we focused on issues surrounding the 
controversy over plagiarism. Our goal was to have 
students understand the often ambiguous nature 
of plagiarism and develop strategies for dealing 
with the issue. They were asked to use blogs to 
post their ideas about plagiarism, comment on 
classmates’ blogs, and use as source texts in their 
written assignments. 

The participant, Miriam (not her real name), 
was a young adult student born in Ethiopia and 
tri-literate in Oromo, Amharic, and English. From 
the reading/writing logs she kept throughout 
the course, we found that she had maintained 
her first and second languages through various 
literacy practices, such as reading the Bible and 
attending church, in addition to learning to write 
in English. In her native country, she was taught 
how to read in British English from the third 
grade until the eighth grade in a very traditional 
educational style. At the end of her eighth grade 
year, she came to the United States and received 
her high school diploma from an inner city public 
high school. Therefore, she seemed to have some 
degree of overall literacy development although 
not necessarily in the forms of literacy being 
taught in composition classes. 
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THE USE OF A COURSE BLOG IN 
AN L2 COMPOSITION COURSE 


The blogs analyzed in this chapter were taken 
from assignments in an academic writing course 
for ESL learners. The students in this course, 
both graduate and undergraduate students, had 
been placed in the lowest level of a set of three 
courses. Students were expected to write a series 
of three assignments: an evaluative summary, a 
synthesis paper, and an argumentative paper. The 
students were not necessarily “deficient” in basic 
literacy skills but may have had multiple forms 
of literacy that may not have matched the kinds 
of skills expected in class. 

The blogs were incorporated in the under- 
graduate course the participants were enrolled in 
asameans of developing students’ writing fluency 
and conceptualizations of plagiarism as well as to 
be used as a secondary text source for students to 
use as sources in their own papers. We assigned 
two to three blogs to write each week. One blog 
was used to discuss various issues that had been 
raised in their readings and classroom discussions 
which could later be developed into an academic 
paper. The other blogs either discussed personal 
topics or were used to respond to the blogs of other 
students. By not correcting the students’ blogs, 
they could be used to exploit whatever forms of 
literacy they were most comfortable with. (so 
neither blogs were corrected?) 


THE USE OF BLOGGING ASA 
FORM OF EXPRESSION 


As with many of the blogs, we had multiple pur- 
poses for the assignment. In our first blogging 
assignment, which was in response to a question 
about how life was going, we wanted our students 
to use their more personal and expressive forms 
of literacy, which we felt students like Miriam 
might feel more comfortable with since she had 
a high level of oral fluency. While, as will be 


discussed later, we used the blogs primarily as a 
tool in the development of academic writing; we 
were also interested in how blogs could be used 
to further some of the social goals of the course, 
which included having the students get to know 
each other so they might feel more comfortable 
in the class and in how they interacted with their 
classmates. In this blog, the students were asked 
to discuss a recent day in their lives: 


Hey guys how are you doing today. I really have 
some thing to talk about today. Yesterday morning 
I had to go to work at 10:00 o’clock. To let you 
know before what happened to me I don’t live in 
dorm I drive to the school every time I live with 
my parents. However when I got to Chestnut rd. I 
stacked in there it was so crowded you can't pass 
the light without stopping like four or five times 
guess what because of the game every people 
driving fourth St. and high St. goes to OSU and 
I was also heading in to OSU. Wow it was so 
crease and bad day to me, but I didn’t have any 
body to mad at about. This is what happened to 
me as I have C parking tag I should able to park 
on C parking late right I couldnt find any spat 
finally I park the place I used to park when I went 
to class during on summer. Unfortunately I used 
to work OSU and have free African American 
101 class in there, it was student internship job 
Ican still rehire next summer ones you start you 
can hire every summer don’t be Julius, Because 
I know you all. I’m just joking, but it wasn’t jock 
for me yesterday. Back to my topic because of 
the crowded traffic I was let to work, but I called 
and let them know that I was going to be let. Like 
I just said I just park some where I knew before 
then its amazing they tow my car. OSU is so bad 
some times they should know that I am student I 
don’t have extra money for them. Oooooohhhhhh 
it’s so sad I paid 110 dollars to got my car out. 
You know it was so cold yesterday, you feel me 
right guys I was waiting for my ride more than 
30 minutes out there, on the way. 
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In Miriam’s first blog, we can see a fluency 
in expressive writing that was not seen in her 
early classroom writing. Consistent with what 
Blanton (2005) found in her study of an Ethiopian 
undergraduate, Miriam’s grammar, spelling, and 
vocabulary are clearly non-standard. Her jumping 
from one topic to another is more indicative of 
organization in oral expression than in academic 
discourse. However, the blog showed her potential 
as a writer as well. Her text contained almost 
400 words, which was almost as long as what 
was expected in the first classroom assignment, 
which encouraged us about her literacy potential. 
The details of her narrative are engaging and 
well developed. Moreover, her blog also shows 
awareness of her audience and how she tries 
to connect with them through her writing. Her 
references to the parking problems and having 
her car towed was something all the students, 
at least the ones with cars, can easily related to. 
Thus, her blog clearly indicated a potential for 
academic writing that we had not yet seen in her 
classroom assignments. 


BLOGGING AS A TOOL FOR 
ACADEMIC WRITING 


The second purpose of the blogs was as a heuris- 
tic for generating ideas and sometimes pieces of 
texts that could be used in their academic papers. 
Although the primary focus was on academic 
writing, the blogs served to counterbalance the 
predominance of the course on academic literacy, 
with which many students like Miriam are prob- 
ably unfamiliar, by allowing these students to 
express themselves in a form of literacy which 
they may feel more comfortable using. At the 
same time, we wanted to use the blogs to introduce 
the students to various rhetorical strategies that 
were common in academic writing, including 
summarizing, synthesizing, and arguing using 
source texts as a basis for making and supporting 
one’s own claims. 
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One of the most problematic issues of academic 
writing for ESL learners has been taking critical 
positions. As Bruno Latour (1988) has argued, 
being able to neutralize contradictory claims is 
an essential means for establishing the validity of 
the claim. However, research has shown that many 
ESL students find it difficult to criticize published 
authors as well as classmates whom they have to 
confront in a face-to-face context. 

Many of the blogging assignments were 
designed to have the students critically evaluate 
what they had read and what their classmates had 
written. In this blog, the students were asked to 
respond to another student’s blog in the same 
way that the students were expected to respond 
to what they had read in their academic writing. 
Here, Miriam criticizes a high school student she 
had read about who had been expelled from high 
school because she had cut and pasted part of her 
essay from the Internet. 


Hi Ali [not his real name] This is Miriam. When 
I read your opinion that you have written on 
Haley’s plagiarism it seems like you’re going to 
say, is not a problem that she made a mistake on 
what she have done. You were concerning on the 
people got her expelled, like your opinion. Is not 
only about that she expelled what about her big 
fault she did When I think on the positive way yes 
its awful and sad expelling form school, but let 
see how many mistakes she had. She should stop 
do some thing what makes her popular mistaker 
on some thing doen’t help or make her a good 
professional. She should quit after she got suspend 
on the first time. Its all her fault. As your written I 
don’t think is exaggerating, this is not a real small 
thing in the real world lik yu think. We all have to 
be carre full, and baing realponsible on what we 
are doing. I had survey class this morrning, so 
the guy were talking about plagerism. how bad 
habit is it for the people who cut and past. There 
were interesting idea on what he mention, which 
is how all profecer know about plagerism and 
if your paper is not comes out of your work. He 
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actualy said that he is exper on coughting people, 
even if you translet the word to your own word. 
So what do you think about this ? We though that 
is not a big dill before. They need our try and 
our own word to be succesfull. Iam not having a 
bad adia about the we site too, I will never have 
iether. having that Web site is like help. Is is up 
to you how you use it. don’t copy down from it , 
unless you have get an idea. This is what I think 
about the Web site. 


Herblog shows againa great deal of complexity 
inher writing. Despite her difficulties with syntax 
and vocabulary, her strength, compared to what 
we often find in the papers of our international 
students, can be found in her ability to strongly 
express her opinions, which is a rhetorical strat- 
egy essential for developing an argument in an 
academic paper. She also demonstrates a variety 
of rhetorical strategies in her refutation of her 
classmate, including metacognitive (an awareness 
of audience), logical (that plagiarizing does not 
help her become a professional), and anecdotal 
(how her professor warned the class about pla- 
giarism). On the other hand, the orality of her 
writing is clear here and is consistent with what 
the research on some ESL students has shown. 
Using the term “interlanguage” (Selinker, 1992), 
which was originally applied to second language 
acquisition, Kutz (1986) described this level of L2 
literacy development as existing on a continuum 
between what she calls the “everything goes” 
approach and the application of strict academic 
rules. We can, therefore, place Miriam’s literacy 
development on this continuum where some 
aspects are clearly deficient, in some areas of 
literacy development but other areas show great 
potential. 

The pedagogical question was, therefore, 
how to use her stronger areas of literacy to help 
develop her weaker ones. One aspect of aca- 
demic writing that Miriam often struggled with 
was the use of source texts in the development 
of her ideas. Research has shown that the use of 


source texts is not often taught in American high 
schools (Hillocks, 2002). The primary goal of the 
summarizing assignment was to have the student 
identify the opinions of the various actors in the 
stories they had read so that they could use their 
opinions in their argumentative papers. In the 
following blog, Miriam takes the development of 
her critical skills a step further by using sources 
from one of the articles she had read to support her 
argument. The students had read an article about 
a high school girl who had been expelled from 
school for plagiarizing (Heaton, 2003). The article 
contained the opinions of both the girl’s mother, 
who was upset about the expulsion, and the head 
of the school (Berkman), who defended it. 


I don’t think Lodge could defend her doughtier 
like this. Because like Berkman said the students 
have enough told what’s not acceptable and ac- 
ceptable in school. On another hand Turnitin. 
com is Hawken teachers disposal to support the 
student on standards of honesty. This means the 
student know the rule of the school and what their 
teacher are going to do because it’s the school 
rule, rule is what every body has to know. I agree 
with Berkman because he mention every thing 
what the student have to do that also shows it’s 
the student responsibility to be care full on what 
they’re doing. 


Again, her language in the blog is more oral 
than is usually found in academic writing, as 
exemplified by expressions like “I don’t think” 
rather than simply stating what she felt was wrong 
with the mother’s defense of what her daughter 
did. However, there also is a sophistication in 
how she brings in an outside source (her reference 
to Berkman) to show his consistency with her 
own opinion. By using this source, she can more 
strongly develop her argument that the girl should 
be expelled. Her ability to use these sources was 
important not only in what it indicated about her 
development of her academic writing skills but 
also for demonstrating her understanding of one 
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of the key issues regarding plagiarism that had 
been discussed in class: that an argument can be 
strengthened if it is shown to be consistent other 
arguments that had previously been made. 


The ability of blogging to foster connectivity 
among authors, in this case the students in the 
class, thus had great potential for developing in- 
teractions among the students. Since the earliest 
uses of the Internet in the classroom, teachers 
have wanted to use digital writing as a means for 
extending the audience for classroom writing. In 
academic writing, the use of source texts, even 
texts that one may disagree with, can establish 
a dialogue between the writer and these texts. 
Miriam frequently made the dialogic nature of 
blogging explicit by directly addressing her class- 
mates, a rhetorical strategy the other students did 
not frequently use. 

In the blog below, she was asked to further 
develop her argument by responding to a blog her 
classmate had written about a student named Mar- 
ita, who had been accused of plagiarism because 
she had copied something from an encyclopedia 
without properly citing it (Rose, 1989), Miriam 
had argued that Marita was not trying to cheat but 
simply did not know the conventions of academic 
writing. Rose (1989) believed that much of her 
problem resulted from the contradicted between 
the nature of the assignment, which asked her 
to write on a topic she knew nothing about and 
advice her father had given her about not speak- 
ing about topics unless she had something to say. 
The problem was compounded by the fact that she 
had no experience in high school in using source 
texts, so when she did her research, she simply 
copied what she had read. Many of the students, 
who felt they came from similar backgrounds, 
were sympathetic with her dilemma. 

In the blog, the students were asked to respond 
to what another student had written comparing 
Marita’s act of plagiarism with Haley’s: 
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Hi Yo Jae Lee [not his real name] how are you 
doing. I would like to respond regarding to you 
assay, because you just said just like I said. Iagree 
with you idea. Like you said, Haley knows that she 
was plagiarizing, also we knew that she did that 
on purpose. Just like you said Marita case and 
Haley are not the same. Marita was trying to do a 
good job on her work she didn’t know that coping 
down in not plagiarized, as the article and we said 
to no one told her that she was doing wrong. She 
doesn’t have to punished that same as Haley. 


As she did in many of her entries, she directly 
addresses the writer of the blog she was respond- 
ing to, again indicating an oral awareness of the 
interactive nature of the discourse. She first states 
her agreement with her classmate’s opinion and 
then goes on to develop her own argument about 
whether Marita had committed plagiarism and 
whether she should be punished. She begins her 
argument by announcing directly that she agrees 
with the claim, rather than, as is often the case in 
academic writing, by saying something that agrees 
with the claim or by simply not disagreeing with 
the claim. She goes on to argue in a clear and 
logical fashion, that since Marita was “trying to 
do a good job” and that “no one told her” what 
she did was wrong, she should not be punished 
in the same way as the other students. She then 
makes a second distinction about getting help on 
an essay and concludes with her claim of the need 
for different forms of punishment. 

Although both her organization, particularly 
how she addresses the author, and her language 
is often informal, her rhetoric reflects the argu- 
mentative strategies found in academic writing, 
particularly how she weaves her own opinions 
with those of the other students. 

These blogs also illustrate something about 
the nature of blogging and how its nature can 
be mediated by its implementation and how 
students utilize them. Perhaps because of the 
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greater emphasis placed on authorship in blogs, 
they do not seem to encourage the same forms 
of dialogic interactions as other forms of CMC, 
such as listservs (Krause, 2005), which are more 
similar to e-mail and thus by their nature may be 
more conducive to fostering conversations. How- 
ever, Miriam’s response to her classmates’ blogs 
show how she attempts to make her writing more 
interactive, which may be a rhetorical strategy 
more closely associated with her oral forms of 
discourse. By doing so, she is adding a dimension 
to blogging that may transcend the limitations of 
its architecture. In this way, she utilizes the blogs 
not as abstract, distant texts that are often found 
in academic writing but as a personal text that 
has been directly addressed to her to which she 
then directly responds. 


MOVING BETWEEN BLOGGING 
AND THE CLASSROOM 
ASSIGNMENTS 


The development of academic knowledge has 
been shown to result from an interaction of 
different forms of oral and written discourses 
that range from informal discussions to formal 
papers. In their discussion of oral and written 
forms of language in academic writing, Gilbert 
and Mulkay (1984) emphasize the relationship 
between how these different forms of discourse 
are used and the nature of the language that is 
used in different contexts for different purposes. 
While blogs do not always capture the dialgogic 
nature of oral language, they do encourage a 
spontaneity of thought, which we tried to en- 
courage by having the students not worry about 
their grammatical correctness. It was hoped that 
the students could, to use Canagarajah’s (2005) 
term, “shuttle” between the different forms of 
discourse. Canagarajah (2005) uses this shuttling 
metaphor to describe how academic writers move 
between these different forms of discourse. He 
argues that this metaphor is useful for thinking 


about the relationship between different forms of 
discourse English-language learners bring to the 
classroom and the pedagogical values of using 
multiple forms of discourse in the teaching of 
academic writing. 

The shuttling metaphor became an important 
way forus to think about the relationship between 
the blogs and the classroom assignments. In one 
classroom assignment, the students were asked 
to summarize and evaluate an article about a 
professor who had been accused of plagiarizing 
because he had published an op-ed piece ina local 
newspaper that had been ghostwritten. Inthe blog, 
the students were asked to first evaluate whether 
his ghostwriting should be considered to be pla- 
giarism in a way in which they could then use in 
the evaluation part of their argumentative paper. 
Inher blog, Miriam expresses her confusion about 
whatis meant by plagiarism, which was something 
we wanted to see in the students since we wanted 
them to feel that plagiarism was a confusing topic 
and not one that could be clearly defined. In the 
blog, she tries to compare the allegations against 
the professor and against Haley. 


Iam really confused about this professor. I prefer 
not to say this is plagiarism. Plagiarism has his 
own word and ghostwriter has his own mining 
too. I would like to repeat what Aldemir [her 
classmate] said, because like he said “plagiarism 
is the duplication of original material without the 
knowledge or permission of the originator ” having 
aghostwriter is like having an editor. This is what 
I believe too, of course it might be wrong what 
he does on public. He brings out his vision idea 
on the newspaper. That is really really wrong. I 
can’t even compare him with Haley. She cheated 
she copy, also she cut and past some ones work. 
Her work is really plagiarism and she knew that 
she is plagiarizing on purpose, even thought she 
didn’t stop when she has done that. This profes- 
sor is I hope he is researching staffs because he 
is professor, it’s his job researching some thing. If 
OSU believe that this professor plagiarized they 
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should punish him. But Iam not going to say that 
they have to punish him as students standard. 
Because this person spend a lot of years on his 
degree, and he spend a lot of money on himself. 
If they think that his work is not good for his 
student they could do some thing about it. ather 
than that i’ll not say that they have to treat him 
the same as student. I can not compere him with 
Haley work. 


Miriam uses her blogging voice to explore 
the various questions concerning the nature of 
plagiarism and how it should be dealt with. She 
begins with expressing confusion over whether 
the professor had plagiarized in the way the other 
students she had read about did. She tries to work 
through this confusion by comparing his act to 
Haley’s and then concludes with her thoughts 
about punishment 

We can see in her blog an ability to problema- 
tize these issues in the debate over plagiarism and 
begin tosee that plagiarism was notmonolithic as it 
is sometimes taught. Rather than seeing plagiarism 
in absolute terms, her understanding appears to 
become more tentative, as illustrated by how she 
begins her blog by saying “I am confused.” She 
seems to understand that the boundary between 
what is acceptable and what is unacceptable can 
be unclear as well as the need for different types 
of responses from teachers and institutions. Again 
we see the interaction between her academic voice 
and oral discourse as illustrated by her citation 
of her classmate’s, which was followed by the 
incorporation of her oral, more personal, expres- 
sive as a way to respond to the quotation. 

In the next writing assignment, the students 
were asked to synthesize the three different 
stories about plagiarizing discussed in class. 
By this point in the class, the students had al- 
ready worked through all of the issues, they had 
discussed in class, so now the goal was to have 
them move between the blogs and their academic 
paper. Here again, we used the blogs as a writing 
space where the students could develop some of 
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the rhetorical strategies they would use in this 
synthesis paper. In this blog, as in the classroom 
assignment, Miriam was asked to synthesize her 
responses to all three of the stories, comparing 
their similarities and differences. 


This three people plagiarized, even thought the tow 
of them are accused to plagiarism. On this situation 
there are a difference and similarity between them. 
On the first place if I give the fact of plagiarism 
Ill say yes Haley plagiarized. Because happened 
to her was a fact, she did everything on purpose 
instead of trying her past, she pushed her self to 
copy down some one’s work. That work expelled 
her form school. That was the punishment she 
got, even if it’s too much for her to expelled form 
her current school. Marita accused plagiarized. 
However her case and Haley’s case are not the 
same it’s a lot difference between the tow, because 
Marita did honest work she didn’t meant to cheat 
like the school though at the end of her work she 
listed every thing out what she used for her refer- 
ence. Jamalis a smart student and he is a scholar 
athlete for his school, unfortunately he accused 
plagiarized by his English teacher. Of course yes 
he got herlp form the smart guy how has a book 
written, so getting help doesnt makes you cheater. 
Three of them are different cases and they should 
have different punishment, because making wrong 
and having help is not the same. 


What particularly interested us here was her 
ability to abstract the relationships between the 
two cases she was discussing and then explain 
the details. She began to draw specific issues 
about the nature of plagiarism and the differ- 
ences in intention that could be used as a means 
of organizing her paper. She was able to break 
away from simply summarizing the text, which 
was what some of the other students still did, 
and weave in her own opinion about how the 
examples of plagiarism differed. However, she 
did not do this consistently. When she introduces 
the story of Jamal, a character in a movie called 
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Finding Forrester who had also been accused of 
plagiarism, she did not go beyond the summary 
to make a connection between the accusation of 
plagiarism against him and the other two stories. 
This incompleteness of her academic voice in 
the blog was something she would struggle with 
in her academic paper. Nevertheless, the blogs 
revealed significant progress inthe development of 
her academic voice although she would continue 
to have problems transferring her voice from her 
blogs to her classroom assignment. 


CONCLUSION 


Teachers often ask the question “How can we 
use blogs in the L2 writing classroom?” A better 
question might be to start with the question “What 
problems do L2 writers have” and what kinds 
of technologies might work in helping us deal 
with these problems?” Our problem was to help 
students who had little background in writing the 
kinds of academic writing we expected. Blogging 
gave the students the opportunity to write using 
whatever form of literacy they wish to using the 
type of language they felt most comfortable with. 
As Canagarajah (1999) has argued, it is impor- 
tant for teachers to value the kinds of language 
students bring to the classroom. By including the 
blogs as an integral part of the course as well as 
their grades, we attempted to give value, to the 
more expressive and personal forms of writing 
our students like Miriam may have been more 
comfortable with, as well as allowing them to 
use the levels of language the students already 
possessed. 

We also attempted to extend the types of 
dialogic interaction Miriam displayed in her re- 
sponse to the blogs of her classmates by having 
the students cite their classmates blogs in their 
academic writing in the same way they would 
cite any other text. By combining these different 


forms of discourse, we hoped to explore blogging 
both as a tool for helping students develop their 
writing and a form of discourse in itself. This 
view of blogging reflects the growing importance 
of blogging itself as a form of discourse. Since 
this number is growing around the world, not 
just in English but in many different languages, 
blogging has emerged as an important genre in 
itself. But the nature of the genre is not always 
clear. How we approached the pedagogical use of 
blogs has been shaped by the recognition that the 
use of blogs in an academic writing class, as with 
any technology, is never neutral; its implementa- 
tion can affect the nature of the writing and by 
backgrounds of the students. At the same time, 
the nature of the classroom-based writing can be 
affected by their usage. 

There are many questions, however, that re- 
main to be answered about the role of blogging in 
the composition classroom. Does blogging, asseen 
in Miriam’s work, in fact reinstate the primacy 
of authorship that had been challenged by other 
forms of computer-mediated communication and 
is the nature of this possibly new form author- 
ship the same as found in print texts? Where are 
blogs situated in the oral/written continuum in 
comparison to formal academic writing and how 
these different forms of discourse interact so that 
one form can help in the development of another? 
How can we facilitate the “shuttling” process be- 
tween these different forms? The answers to such 
questions can vary according toa variety of factors 
that can affect the implementation process, some 
of which have been discussed in this chapter. De- 
spite the difficulty in answering these questions, 
if blogging continues to be an important form of 
literacy both inside and outside the composition 
classroom, having students blog, is like having 
them write academic discourse, immerses them 
in a genre that is growing in importance. 
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KEY TERMS 


Academic Writing: The genre of writing 
frequently found in a university context. 


Blogosphere: The network of blogs that exists 
on the Internet. 


Blogs: On line journals that can be updated 
frequently and contain a feed that notifies readers 
when they have been updated. 


Computer-Mediated Communication: The 
variety of forms of communication that can occur 
using the Internet. 


Generation 1.5: Immigrant students who 
arrived after acquiring their first language but 
who spent at least some time in English-language 
schools. 


Literacy: The ability to read and write infor- 
mation from a fixed medium. 


Plagiarism: The inappropriate appropriation 
of texts. 
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ABSTRACT 


This chapter introduces second language reading in hypertext/hypermedia environments. It discusses 
the development of a template to annotate reading texts with multiple types of media such as text, sound, 
graphics, and video so as to aid reading comprehension for L2 readers. The chapter also reports on a 
series of studies conducted using the template in a variety of L2 learning environments in order to explore 
L2 learners’ reading behavior and the effects of multimedia annotations on L2 reading and vocabulary 
learning. The chapter synthesizes the results according to multimedia learning theories and discusses 
the role of proficiency level and prior knowledge in relation to L2 learners’ reading comprehension in 


hypertext environments. 


INTRODUCTION 


Historically, students studying a second or for- 
eign language have experienced reading foreign 
language texts in different ways. Marginal notes 


provided by the author(s) have been made avail- 
able as an aid to reading in a foreign language 
for centuries; they were used as a study aid to 
understand Latin, for instance. The purpose of 
these marginal notes was to explain the text or to 
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provide additional grammatical or updated infor- 
mation. Marginal or footnotes or endnotes are still 
used in this manner to help readers. Glossaries 
were and still are used to help readers understand 
a text. Glossaries typically contain items that the 
reader is likely to not know (Roby, 1999). 

With the advent of computers, annotations can 
be provided to readers when they indicate they 
need help. In effect, the annotations (or glosses) 
can be hidden from view and shown whenever 
requested. Pedagogically, it is believed that an- 
notations help the reader understand the text. 

Studies that investigate the effects of electronic 
dictionaries, glosses and annotations for L2 read- 
ing have revealed inconclusive results. Roby (1991, 
cited in Roby, 1999) and Aust, Kelley, & Roby 
(1993) did not find electronic dictionaries more 
beneficial than paper dictionaries in facilitating 
reading comprehension. Similarly, Davis and Ly- 
man-Hager (1997) did not find any meaningful 
relationship between access to glosses and reading 
comprehension. On the other hand, Leffa (1992) 
found that beginning level English as a Foreign 
Language (EFL) learners benefited more from 
access to an electronic dictionary during reading 
than a traditional bilingual dictionary. Moreover, 
Lomicka (1998) found that participants in full 
glossing condition (i.e., LI translations, L2 defini- 
tions and pronunciations, images, references and 
questions) scored significantly higher in read- 
ing comprehension than participants in limited 
glossing (i.e., L1 translation and L2 definitions) 
and no glossing conditions. On the other hand, 
Knight (1994) suggested that verbal ability was 
an important factor interacting with the effects 
of access to an electronic dictionary. She found 
a substantial correlation between reading com- 
prehension and access to an electronic dictionary 
for a low verbal ability group and low correlation 
for a high verbal ability group, suggesting that 
an electronic dictionary may be more beneficial 
for low verbal ability learners. Chun (2001) con- 
firmed the role of verbal ability in a study with 
L2 learners of German. She found that the low 


verbal ability group benefited more from access 
to within-text glosses and an online dictionary 
than the high verbal ability group. 

In the field of multimedia study, Paivio’s Dual 
Coding Theory (Paivio, 1990) and Mayer’s Multi- 
media Learning Theory (Mayer, 2001) have pro- 
vided important rationale for providing multiple 
representations of information using graphics, 
sounds and even video in text annotations. Dual 
Coding Theory holds that there are two different 
classes of phenomena that are handled by two dif- 
ferent subsystems. One subsystem is specialized 
forthe representation and processing of nonverbal 
objects and events while the other subsystem is 
specialized for dealing with language (Paivio, 
1990). While each subsystem may be thought 
of as independent, they are interconnected as 
associational pathways are created linking the 
nonverbal with the verbal subsystems. It also is 
posited that the dual representations strengthen 
each other by providing two ways to access stored 
information. For instance, when multimedia 
materials provide textual information in addition 
to graphic information, it is theorized that the 
dual representations help learners assimilate or 
understand the materials better. 

Mayer bases his Multimedia Learning Theory 
on Paivio’s Dual Coding Theory by assuming 
that the human information processing system 
includes dual channels for visual/pictorial and 
auditory/verbal processing (Mayer, 2001, p. 41). In 
addition, Mayer posits that active learning involves 
carrying out a set of cognitive processes during 
learning and that these processes are described 
as follows: Learners 


1. select relevant words from the text or nar- 
ration presented; 

2. they then select relevant images from the 
illustrations presented; 

3. they organize the words into a coherent 
verbal representation and then 

4. organize the images into a coherent visual 
representation, and finally 
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5. they integrate the verbal and visual repre- 
sentation and their prior knowledge. 


In short, the Multimedia Learning Theory 
involves learners engaged in active learning 
when they take in relevant incoming informa- 
tion and then select, organize that information 
into mental representations integrating prior 
knowledge in it. 

Mayer (2001) offers several principles for 
multimedia design based on these theories. The 
multimedia principle suggests that it is better to 
present information in both words and pictures 
instead of in words only. The contiguity principle 
involves presenting words and pictures near 
rather than far from each other on screen as well 
as presenting them simultaneously rather than 
successively. The coherence principle requires 
eliminating extraneous words, pictures and 
sounds. The modality principle involves present- 
ing words as narration instead of on-screentextand 
integrating narration with visual information. The 
redundancy principle suggests that words should 
not be presented both as narration and on-screen 
text. Finally, the individual differences principle 
suggests that design effects are stronger for high- 
knowledge learners than low-knowledge learners. 
There is substantial empirical evidence to support 
these principles from L1 studies. However, there 
are few L2 studies that investigate the validity of 
these principles for L2 learners. The L2 studies 
have mostly focused on the multimedia principle 
through studies that investigated the effectiveness 
of multimedia glosses (annotations) on L2 reading 
and vocabulary learning. 

Few studies have investigated the effective- 
ness of multimedia annotations for L2 reading. 
Plass, Chun & Leutner (1998) conducted a study 
with L2 German learners who read a story that 
is accompanied by a translation of words (i.e., the 
verbalizers), and a translation of words, pictures 
or videos associated with the words (i.e., the vi- 
sualizers). They found that visualizers recalled 
more propositions that allowed for both visual 
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and verbal annotations compared to proposi- 
tions that allowed only verbal annotations while 
verbalizers performed equally well in recalling 
both types of propositions. Plass, Chun, Mayer, 
& Leutner (2003) investigated the cognitive load 
that might be caused by multimedia annotations. 
German L2 learners read a short story that con- 
tained different types of multimedia annotations. 
The participants were randomly assigned to four 
groups: no annotation, verbal annotations only, 
visual annotations only, and verbal plus visual 
annotations. They found that the groups that 
received only visual annotations and only verbal 
annotations recalled fewer propositions than the 
groups that received no annotations and verbal 
plus visual annotations. These findings point to 
increased cognitive load if only one channel of 
information is used (rather than two or none). 
This provides evidence for Dual Coding Theory 
and Multimedia Learning Theory. 

Annotations also are important in terms of 
vocabulary learning and acquisition. It is thought 
that students acquire the majority of vocabulary in- 
cidentally through being exposed to new words in 
meaningful contexts such as in extensive reading 
and reading for meaning. (Joe, 1995; Horst, Cobb, 
Meara, 1998; Newton, 1995; Rott, 1999; Waring 
& Takaki, 2003). Students do not need to make a 
conscious effort to learn new words but vocabu- 
lary acquisition is a by-product of accomplishing 
some other task (Gass, 1999; Huckin & Coady, 
1999; Hulstijn, 2001; Krashen, 1989; Swanborn 
& De Glopper, 1999; Wesche & Paribakht, 1999). 
However, incidental vocabulary acquisition has 
been shown to be slow and ineffective unless stu- 
dents “notice” the words or expressions (Schmitt, 
2000). Making an effort to learn, and bringing 
extra processing to bear in learning new words 
improves retention of new words. Annotations 
assume a role in noticing and making an effort to 
learn and thus may improve vocabulary learning 
in the second language. 

Studies on the effects of multimedia annota- 
tions on vocabulary learning have suggested 
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beneficial effects of providing visual and verbal 
glosses at the same time. For instance, Plass 
et al. (1998) found that students showed better 
performance on vocabulary posttests when they 
selected verbal (translation of words in English) 
and visual (picture or video representing the 
words) information compared to selecting one 
mode of information. When they selected neither 
mode of information, their performance was 
the worst. Moreover, Chun & Plass (1996), in 
a study with L2 learners of Spanish, found that 
glosses with text (i.e., definitions) plus pictures 
facilitated vocabulary learning more than text 
only glosses and glosses with text plus associated 
videos. However, Al Seghayer (2001), in a study 
with intermediate learners of English as a second 
language, found that glosses that provided text 
plus videos were more facilitative of vocabulary 
learning compared to glosses providing only 
text and text plus pictures. The positive effects 
of providing verbal and visual (pictures or video 
or both) information together also was confirmed 
in more recent studies (Plass et al., 2003; Yeh & 
Wang, 2003; Yoshi & Flaitz, 2002). Thus, these 
studies also provide evidence for multiple repre- 
sentations of information. 

The studies reported in this chapter are to 
further pursue the effects of multimedia annota- 
tions by investigating how a template used to 
design hypermedia reading materials contributes 
to the reading process. The purpose of this study 
is to provide an overview of the template and the 
studies conducted. 


A TEMPLATE FOR READING 


A software template for use by foreign and sec- 
ond language students was designed to generate 
hypermedia texts. The purpose of the template 
is to create teaching materials and to provide 
an easy way to display annotations of all kinds, 
including text in the target or native languages, 


graphics, audio recordings and video as needed to 
illustrate the meaning of the text and to facilitate 
vocabulary acquisition. A second purpose of the 
template is to make it possible to collect data on 
reading behavior for the purpose of conducting 
second language acquisition research. 

The template makes it possible to annotate a 
text with multiple forms of digital media to aid 
comprehension. The user (the materials designer 
or SLA researcher) adds annotations in the form of 
text, graphics, audio and video. Two categories of 
annotation are possible to facilitate both top-down 
and bottom-up processes; textual annotations that 
provide information about the text itself such as 
definitions of words (textual text annotations), 
their pronunciation (textual audio annotations), 
graphics illustrating definitions (textual graphics 
annotations) or video-based annotations (textual 
video annotations). The second category of an- 
notations, extra-textual annotations provides 
extra background information about the topic in 
the form of text (extra-textual text annotations), 
audio (extra-textual video annotations), graphics 
(extra-textual graphics annotations) and video 
(extra-textual video annotations). Textual annota- 
tions appear within the body of text; annotated 
words or phrases are a part of the text and are 
indicated in blue. On the other hand, extra-tex- 
tual annotations appear outside the text and are 
indicated by buttons placed on the margins of 
the screen. When participants click on a word or 
phrase highlighted in blue (textual annotation) or 
a background information button (extra-textual 
annotation), a small information box appears and 
provides a choice of the forms of media available 
(i.e., text, graphics, sound, or video). Users are 
then able to choose and view as many annotations 
as are available. 

The reader’s interaction with the textis tracked 
by keeping a record of the types of annotations 
the reader chooses to view, the amount of time 
(in seconds) the reader spends on viewing the 
annotations and the number of times the annota- 
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Figure 1. A screen shot of the template showing the layout of the screen 


Navigation map 


n. @ release of mecharacal, chemical, or 
muclear energy in a sudden and often violent 


manner with the generation of high 
temperature and usually with the release of 
gases 


4> 


Graphic and video 


annotations appear in this 
space. 


tions are accessed. The data is collected during a 
single reading session and is output as a log file 
at the end of the session. 

The template was used in a French study 
in the US, and an ESL study in the US and an 
EFL study in Turkey. Details of the studies are 
provided below. 


THE FRENCH STUDY 


Inastudy of intermediate-level students of French 
atthe University of Arizona, Cooledge (2004) used 
the template to collect data on reading behavior 
and reading comprehension. Specifically, she 
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Textual 
annotation 


Textual annotations 
are available when 
word is colored blue. 


The highlighted word shows that a 
textual annotation is selected. The 
format of the available annotations 
(text, sound or graphics) appears 
above the word. The definition 


appears in a box below the 
navigation map. 


y. an to caper] after a 
super powerful of concentrated matter 
and energy ten to twenty billion years ago. Since 
then, the universe has contmued to expand, 
graciually increasing the distance between ow 
galaxy and other galaxies Gravity slows the 
expansion of the universe. If the universe ss clense 
enough, the expension cf the universe will 
eventually reverse and the universe will collapse. If 
the cfnsity is not high enough, then the expansion 
wil fcntinue forever. Thus, the density of 

uyveise will determine ‘ts ultimate fate 


Big Bang 
Theory 


Extra-textual 
annotation. These 
may be in various 
formats (text, sound, 
graphics or video). 


Stephen 
Hawking 


was looking for the relationship between reading 
time and annotation access on performance in 
reading comprehension and recall tests. She also 
looked at student variables such as proficiency 
in French, students’ major, reasons for studying 
the foreign language and their relation to reading 
comprehension. 

There were 85 participants in the study, all 
enrolled in French 202, the fourth semester of 
college-level French. There were 59 females and 
26 males participating. Of the nationalities repre- 
sented, there were 78 Americans, four Canadians, 
two Mexicans and one Swede. All participants 
were givena French Computer-Assisted Placement 
Examination (F-CAPE) test that was used as a 
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proficiency measurement for French. In addition 
to doing the reading task, participants completed 
a background questionnaire, a set of comprehen- 
sion activities including a recall task and multiple 
choice comprehension questions. A post-reading 
questionnaire that addressed reading strategies, 
computer and language learning, preference for 
the language of annotations, helpfulness of the 
annotations, and so on also was administered. 
Cooledge (2004) chose four texts from among 
the large variety of texts used in first and second 
year French textbooks. She then pre-tested them 
among a group of 63 volunteer intermediate learn- 
ers of French. This volunteer group did not take 
part in the actual research except to help describe 
the readability and comprehensibility of the ma- 
terials. Participants were asked to read silently 
one of four texts and perform follow-up tasks 
which were designed to gather insight on texts’ 
comprehensibility/readability, content appeal and 


lexical and syntactic difficulty/complexity. One of 
the reading passages was chosen as the one most 
fitting: an authentic francophone text, written for 
the target culture entitled “Sita Ena,” by Marie 
Angéle Kingué. 

Input also was sought from intermediate level 
French students to determine which of the words 
in the text were to be annotated. A group of vol- 
unteers was asked to underline all difficult and/or 
unknown words and expressions as they read. 
Again this group of volunteers did not participate 
in the study except to identify words that would 
eventually be glossed. One hundred and thirty- 
eight words and expressions were identified by 
these readers as candidates for annotations. Next, 
the items identified were pre-tested with two more 
groups of intermediate French students. Finally, 
135 words were annotated in the text. Three were 
dropped because they were known by 80 percent 
of the subsequent readers. 


Figure 2. A screen shot of the French project showing a gloss 


Sita Ena 


2 revois encore Sita a assise dans 
: a 
embellished ire aux 
éclats et frapper des mains en nous 
racontant des histoires assaisonnées qui 
nous laissaient pantois des journées 
entiéres et dont elle seule avait le secret. Je 
la revois aussiles aprés-midi devant la 
maison, interpellant les voisines, taquinant 
quelqu'un. Je ressens méme encore la 
briilure de ses doigts sur mon cuir chevelu 


alors quelle me faisait des tresses. 


Je ne me souviens pas de la premiére 
fois of j'ai vu Sita Ena. Elle arrivait 
toujours 4 limproviste, rest ait quelques 
mois, parfois méme toute l'année, puis un 
jour, aprés une grande dispute, elle 
disparaissait, emportant avec elle son rire, 
sa vitalité, ses histoires et ses réparties 
acerbes. Un jour, elle revenait et se 
réinstallait comme side rien n'était, et tout 
se passait alors comme sielle n'était 
jamais partie. 


Elle était la niéce de mon pére. Il stait 
toujours occupeé delle. Les parents de Sita 
Ena étaient morts trés jeunes. Au bout de 


quelques années d'école primaire, elle avait 
décréte qu'elle nirait plus 4 l'école et qu'elle 
voulait plutét travailler. Les menaces de 
son oncle n'y firent rien, Sita Ena n€tait 
pas du type 4 se laisser démonter. Un jour 
elle s'en alla dans le Nord Ouest du pays, 
zone anglophone qui s'appelait alors 
Cameroun Oriental pour travailler dans les 
plantations de the. Lorsqu'elle en revint, 
elle parlait le pidgin anglais qu'elle essaya 
aussitét de nous apprendre. Nous étions 
aussi heureux que sielle nous avait appris 
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The template was used to display the text and 
annotations. In this particular use of the template, 
there were no multimedia annotations nor were 
there any annotations referring to any words other 
than those in the text. All annotations provided 
were textual and on two levels. A click on a word 
revealed either a) lexical assistance in French or 
b) “No information available.” For all items an- 
notated in French, a second level of information 
was available in English by sliding the cursor intoa 
pop-up textbox. The English annotation remained 
on the screen until the mouse button was released. 
The annotation path of French then English was 
designed to provide more target language input 
for the readers since they would encounter the 
French gloss first. 

In the French study, the story is presented as 
two columns on the screen. The “Sita Ena” hy- 
pertext appeared completely unmarked. To access 
glossing information, the reader positioned the 
cursor on a word using the mouse, then clicked 
and held the button. If a word was glossed (i.e., 
was one of the 135 words of the text that were 
chosen to be glossed), the annotation appeared. 
If the word was not glossed, “no information” 
would appear. The textbox disappeared when 
the mouse button was released. For all items 
glossed in French, a second level of information 
was available in English by sliding the cursor into 
the pop-up textbox. 

All readers had access to all lexical annota- 
tions. According to theiruse of annotations readers 
were categorized into three groups: users of no 
annotations, users of French only annotations, and 
users of French then English annotations. Most 
users preferred to access the French-then-English 
annotations. That is, they rarely stopped at the 
information presented in French. They opted 
for the quicker benefits of accessing English in 
most cases. 

In reporting the results of the study, Cooledge 
(2004) calculated a comprehension factor score 
that was devised using comprehension variables, 
namely scores on the multiple choice test and 
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the recall activity. The comprehension factor 
was defined as an addition of the two scores. 
That factor represented an assessment of overall 
reading comprehension for each student. The 
French-then-English group used both French and 
English annotations but relied predominantly on 
English. This group had a significantly positive 
relationship with the comprehension factor score. 
While there was no statistically significant rela- 
tionship between the French-only group and the 
comprehension factor score, there was an inter- 
esting correlation with that group and inference 
generation in a multiple regression analysis. 

As stated above, all participants in the study 
had takena proficiency test at the beginning of the 
project. The test used was the F-CAPE, (French 
Computer-Assisted Placement Examination). Al- 
though the test was designed as a placement test, 
here it was used to gauge the participants’ profi- 
ciency in the French language. The participants’ 
scores on the F-CAPE (a proficiency measure) 
were related to their comprehension factor score 
(a measure of their comprehension of the reading 
passage). A regression analysis showed that the 
F-CAPE had a significantly positive relationship 
with respect to the comprehension factor score. 
The readers who scored higher on the F-CAPE 
scored better on the comprehension tasks. 

Cooledge’s (2004) research shows a sig- 
nificant relationship between textual annotations 
that provide information in the student’s native 
language and comprehension as measured by a 
comprehension factor score. There are many fac- 
tors to consider in understanding these results, 
of course. Cooledge (2004) proposes two that 
are relevant because they are departures from 
conditions normally encountered in hypertext 
reading studies: 


1. a two-prong approach to evaluate reading 
comprehension and 

2. the software template, the vehicle through 
which the reading materials are presented. 
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Cooledge (2004) evaluated comprehensionas a 
combination of multiple choice items and a recall 
test. In the recall test students were instructed to 
write in English as much of the text as they re- 
called. Cooledge (2004) used independent raters 
to score the recall test. She broke down the text 
into its component idea units and instructed the 
raters to accept virtually any recognizable piece 
of the meaning of the text that also was present 
in the recall. The two scores were combined into 
a comprehension factor score which may have 
been a better evaluation of comprehension since 
it combined scores from the objective multiple 
choice test and the less prescriptive recall test. 
Cooledge (2004) also proposes that a “software 
variable” may account for improved comprehen- 
sion. In other words, it may be that the software 
used (the template) may be a factor in the results. 
The hypertext environment, while it provided the 
support needed for greater comprehension of the 
reading passage, didso only for those students who 
took full advantage of the available supporting 
information. For those students who did not take 
full advantage for various reasons (they did not 
know that the information was available or did 
not pursue information), the template itself may 
have been a factor. If the template made it more 
clearthat information was available, students may 
have used it. She suggests that further research 
involving the presentation of reading materials 
using various software would be a useful study 
in itself. 


THE ESL STUDY IN THE U.S. 


Ina study involving 84 adult English as a Second 
Language (ESL) students enrolled at the Center for 
English as a Second Language (CESL) at the Uni- 
versity of Arizona, Ariew and Ercetin (2004) used 
the template to explore the effect of hypermedia 
annotations onreading comprehension. The study 
investigated whether the effectiveness of annota- 
tions differs according to the proficiency levels 


of students. They posited that prior knowledge 
about the topic would be an important predictor 
of reading comprehension both for intermediate 
and advanced readers. They further posited that 
textual annotations (i.e., those provide information 
on the words in the text) as well as extra-textual 
annotations (i.e., those provide extra information 
about the topic) would facilitate reading com- 
prehension for intermediate readers. They also 
hypothesized that the use of annotations would 
not be a predictor of reading comprehension for 
advanced readers. 

The participants were enrolled in 9 English 
for academic purposes classes at CESL. The 
participants represented a variety of language 
backgrounds: Arabic (29), Spanish (16), Japanese 
(13), Korean (10), Chinese (5), Indonesian (2), 
Portuguese (2), Thai (2), Bulgarian (1), Turkish (1), 
German (1), Pular (a West African language) (1), 
Vietnamese (1). There were 58 male and 22 female 
participants (four did not indicate their gender). 
Students were placed in the classes according to 
their performance on a standardized placement 
test (the “Comprehensive English Language Test 
for Learners of English” [CELT]). There were 
34 intermediate and 50 advanced participants 
in the study. 

The text selected was based on aseries of video 
programs produced by the Public Broadcasting 
Service (PBS), entitled “Stephen Hawking’s 
Universe.” To investigate the difficulty level 
of the text and comprehension questions, five 
intermediate and advanced readers who did 
not take part in the actual research were asked 
to read the article. They read the text on paper, 
underlined the difficult words and answered the 
comprehension questions. They were then asked 
whether they thought the passage was difficult in 
three areas: content, vocabulary and grammar. A 
short follow-up interview provided more subjec- 
tive opinions about the difficulty of the text and 
comprehension questions. 

The template was then used to annotate the 
text with multiple forms of digital media to 
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enhance reading comprehension. Text, graphic, 
audio and video annotations were added. Words 
that were marked as “difficult” during the pilot 
study were annotated, as were words that were 
considered important. Extra-textual annotations 
were provided for difficult concepts and ideas. 
These annotations were identified by the pilot 
study participants as they answered the compre- 
hension questions. The concepts where they had 
difficulty became the subjects of the extra-textual 
annotations. (Refer to Figure 1 for a screen shot 
of the software in this study.) 

Areading comprehension test was prepared to 
test students’ comprehension of the materials. The 
testincluded 14 items: six short-answer questions, 
six multiple-choice questions and two open-ended 
questions. The participants did not have access 
to the reading text during the test; they used 
their notes that they took while reading the text 
to answer the questions. Another test, consisting 
of 10 true/false questions, assessed the partici- 
pants’ prior knowledge about the reading topic. A 
background questionnaire gathered information 
about the participants and their experience with 
technology as well as demographic information. 
Finally, 20 volunteers each from the intermediate 
and the advance group participated in interviews 
one to three days after completing the compre- 
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hension test. These half-hour interviews provided 
supplementary data concerning participants’ use 
of annotations. 

Data from the participants was collected in 
two class sessions, during which they completed 
(in the following order) the prior knowledge test 
and the background questionnaire, read the text 
using the annotations and completed the compre- 
hension test. Two log files were generated from 
this session: one contained data on annotation 
use and the other the participants’ answers to the 
comprehension test. In a separate data collection 
phase, 20 volunteers each from the intermediate 
and advanced group were interviewed. 

One data file contained a detailed tracking 
of each annotation accessed by each participant, 
including a listing of the annotation, whether it 
was a textual or an extra-textual annotation, its 
media type and the amount of time spent on the 
annotation (expressed in seconds). The other file 
contained each participant’s answer to the reading 
comprehension questions, including short, mul- 
tiple choice and open-ended answers. In addition 
to the data file information, other variables used 
in analyzing the results were participant’s prior 
knowledge, and qualitative data from question- 
naires and interviews. 


Table 1. Correlations of independent variables with reading comprehension 


|Variables Group 
intermediate advanced 

Prior knowledge ott .29* 
[Textual text annotations -.07 -.08 
{Textual graphics annotations -.15 -.22 
{Textual audio annotations -.13 -.21 
IExtratextual text annotations .08 .26 
IExtratextual graphics annotations -.38* 05 
IExtratextual audio annotations -.29 .04 
IExtratextual video annotations -.43** .09 


*p<.05 **p<.01 
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For the intermediate group, there was a sig- 
nificant positive relationship between reading 
comprehension and prior knowledge. The more 
this group of readers knew about the subject mat- 
ter before reading the materials, the more likely 
they were to have a higher score on the reading 
comprehension test. There also were significant 
negative relationships between reading compre- 
hension and the time spent on extra-textual video 
and graphics annotations. Correlations between 
reading comprehension and time spent on other 
types of annotations were either low or negligible. 
For intermediate readers it seems they did not 
profit from use of the annotations to improve their 
reading comprehension except in a negative way. 
Time spent on extra-textual video or graphic an- 
notations seemed to reduce rather than increase 
their comprehension scores. 

For the advanced group, there was again asig- 
nificant positive (but weak) relationship between 
reading comprehension and prior knowledge. 
There were no other significant relationships to 
be noted in the analyses. The time that advanced 
readers spent reading or viewing annotations did 
not seem to improve their reading comprehension 
scores. However, as with the intermediate readers, 
their prior knowledge about the subject helped 
them comprehend the reading materials. 

Even though the quantitative data did not 
show any significant relationship between use of 
annotations and reading comprehension (except 
for a negative one for the intermediate group), the 
qualitative data obtained from the questionnaires 
and personal interviews showed that participants 
thought that the annotations were useful and read- 
ing ina hypermedia environment was enjoyable, 
interesting and easier to understand. Both the in- 
termediate and advanced readers agreed that most 
types of annotations were useful. They especially 
liked word definitions (text annotations) because 
they increased reading speed. The interviews also 
revealed that the intermediate group thought the 
audio annotations (the pronunciation of words 
and audio recordings) were a good opportunity 


to improve their pronunciation. Some participants 
didnot like extra-textual annotations because they 
thought they provided too much information or 
because there was not enough time to use them. 

Ariew and Ercetin (2004) hypothesized that 
textual and extra-textual annotations would en- 
hance reading comprehension for intermediate 
level readers. That hypothesis was not confirmed; 
only extra-textual video annotations explained 
some of the variability in reading comprehension 
for the intermediate readers. However, it was 
found thatthe two variables were inversely related. 
Video annotations seemed to distract the readers 
and interfered with reading comprehension. The 
researchers suggest that this may provide evidence 
for the “short-circuit hypothesis” (Clarke, 1988) 
which proposes that limited proficiency may lead 
to the use of poor reading strategies and result in 
context biasedness. Consequently these readers 
might have relied too much on the video annota- 
tions to understand the text. They also cite Chun 
and Plass (1997) who provide several reasons for 
the negative effects of multimedia information, 
suggesting in particular that there may be an 
attention split between the types of information 
provided. Also, readers also may have directed 
their attention to the type of information based 
on their interest in the information and not on its 
usefulness to aid comprehension. 

Ariew and Ercetin (2004) also hypothesized 
that advanced level readers would not rely on 
annotations fortext comprehension. This hypoth- 
esis was confirmed. No relationship was found 
between the advanced readers’ annotation use 
and comprehension. These readers seemed to 
have been focused on understanding the text and 
consulting the annotations only when necessary. 
They point to Knight (1994) and Chun (2001) 
who had similar results. They also surmise that 
higher linguistic competence might have enabled 
advanced learners to use good reading strategies 
to read and comprehend the text thus providing 
evidence for the theory that good reading skills 
are only activated at a certain threshold level of 
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linguistic ability (Anderson, 1991; Clarke, 1988; 
Devine, 1988; Taillefer, 1996). 

The study also confirmed that prior knowledge 
about the topic was an important predictor of 
reading comprehension for both the intermediate 
and advanced readers. The study shows that prior 
knowledge contributed more to reading com- 
prehension than annotation use. The interviews 
revealed participants with prior knowledge of the 
subject used extra-textual annotations according 
to their interest or curiosity to fill the gaps in their 
understanding to get amore complete comprehen- 
sion of the topic. 


THE EFL STUDIES IN TURKEY 


Two recent studies were conducted using the tem- 
plate; one was by Sakar and Ercetin (2005) and 
the other by Akbulut (2005). Sakar and Ercetin 
(2005) explored learners’ use of annotations and 
the effectiveness of annotations for reading com- 
prehension with a total of 44 intermediate-level 
Turkish students studying English for Academic 
Purposes at a Turkish university. They used an 
authentic online reading text that was selected 
from the National Geographic Journal Web site 
and annotated the text with multiple types of me- 
dia using the same template used in the previous 
studies. The annotations provided definitions of 
words, pronunciations of words, pictures associ- 
ated with words, and extra-textual information 
about the topic in the form of text, sound, graph- 
ics, and videos. The participants were given a 
reading comprehension test that they completed 
while they read the text. Participants took notes 
while reading and used their notes while answer- 
ing the comprehension questions. They did not 
have access to the text. Qualitative data through 
a questionnaire and interviews were collected 
to obtain information about the participants’ 
experience with hypermedia reading and their 
perceptions of the usefulness of the annotations. 
Results indicated that pronunciations of words 
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were preferred significantly less and videos were 
preferred significantly more than all other types 
of annotations. Thus, the learners consistently 
preferred visual information (i.e., graphics and/or 
videos). These annotations also were rated as 
highly useful by the participants which suggest 
that participants perceived visual annotations to 
be most vital for text comprehension. Interviews 
revealed that most of the participants considered 
visual annotations essential because they were 
interesting and motivating. Thus, the participants’ 
perception of the usefulness of annotations was 
consistent with their actual annotation preferences 
obtained through the log data. An examination 
of the relationship between reading comprehen- 
sion and annotation use showed that reading 
comprehension correlated negatively both with 
the frequency of access to annotations and the 
amount of time spent on annotations. This issue 
will be taken up later in the discussion. 

The results indicate that performance on the 
reading comprehension test decreased as an- 
notation use increased. An examination of the 
correlations between specific types ofannotations 
and reading comprehension revealed statistically 
significant correlations between reading com- 
prehension and pronunciations of words, audio 
recordings and videos providing extra information 
about the topic. However, these correlations were 
negative. A multiple regression analysis revealed 
that extra-textual audio and video annotations 
together explained 20 percent of the variability 
inreading comprehension. However, the negative 
relationship between these variables and reading 
comprehension may suggest that these annota- 
tions hindered reading comprehension instead of 
enhancing it. Again, this will be taken up later 
in the discussion. 

Akbulut (2005) explored the effects of different 
multimedia types onincidental vocabulary learn- 
ing andreading comprehension of advanced learn- 
ers of English. A total of 69 university freshman 
students in the Department of Foreign Language 
Education at a Turkish University took part in 
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Figure 3. Screen shot from the Akbulut EFL study in Turkey 
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the study. An expository text titled Playing with 
Fire was annotated using the template. Annota- 
tions were provided on the words indicated to be 
unknown by a pilot group. The annotations were 
of three types: definitions only, definitions plus 
associated pictures, and definitions plus associated 
movies. Students were randomly assigned to one 
of these three groups. They were given a reading 
comprehension test which consisted of multiple- 
choice and true-false items. The participants did 
not have access to the text during the test; they 
took notes while reading and used their notes to 
answer the questions. The participants also were 
given a vocabulary test that consisted of three sec- 
tions: form recognition that included a checklist 
in which students were asked to recognize every 
single annotated item they remembered from 
the text, meaning recognition that consisted of a 
multiple-choice test of synonym recognition and 
definition recognition and meaning production 
that required students writing the L1 equivalents 
or synonyms of every target word. 

Results indicated that the groups that received 
annotations with definitions plus associated 
movies and definitions plus associated pictures 
performed significantly better on both immedi- 
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ate and delayed vocabulary tests which involved 
form recognition, meaning recognition and 
meaning production. While these groups showed 
better performance on all vocabulary tests, their 
performance was especially superior on mean- 
ing recognition and production tasks. Thus, the 
findings suggest that combining text with visuals 
regardless of the type of visual used is more ef- 
fective in facilitating vocabulary learning than 
providing only definitions of words. On the other 
hand, the treatment groups did not significantly 
differ from each other in terms of their reading 
comprehension scores. 


DISCUSSION 


Studies conducted using the template achieved 
meaningful results that added to our knowledge 
both about the reading process in general and 
about reading in a hypertext or hypermedia en- 
vironment more specifically. Since all the studies 
were conducted using the template in a variety of 
contexts, with different populations, the general- 
izability of the findings is enhanced. Examining 
the readers’ interaction with text using the track- 
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ing tool, questionnaires and interviews, Ercetin 
(2003) found that both advanced and intermediate 
ESL learners preferred visual annotations and 
this finding was confirmed by Sakar and Ercetin 
in their study (2005) which was conducted with 
intermediate level EFL learners. 

As for the issue of whether annotation use 
generally improves reading comprehension there 
is still much left for debate. Most hypertext studies 
do not find a significant link between the use of 
lexical annotations (textual or of various media) 
and comprehension. Overall, the use of annota- 
tions in a hypertext environment does not yield 
measurable text comprehension benefits for read- 
ers; however, there are several provisos that ought 
to be carefully scrutinized. There is substantial 
evidence from L1 studies supporting multimedia 
theories. However, L2 studies are inconclusive. 
The few studies conducted in L2 are more con- 
sistent and positive for vocabulary learning. In 
reading, however, the link between hypertext 
annotation and comprehension is elusive. In 
Cooledge’s study (2004), she did find a positive 
relationship between the use of textual annotations 
that provide information in the student’s native 
language and comprehension. Her findings werein 
line with the findings of Davis (1989) and Lomicka 
(1998) who found glossing to be more useful than 
no glossing. Ariew and Ercetin (2004) and Sakar 
and Ercetin (2005) found this not to be the case. 
Ariew and Ercetin’s (2004) findings suggest that 
annotations, when used abundantly, may actually 
hinder reading comprehension for intermediate 
level ESL learners. This view was confirmed by 
Sakar and Ercetin (2005) in their study when 
they found negative correlations between overall 
annotation use and reading comprehension. An 
interesting finding that may have some relevance 
to pedagogy is that, for the intermediate readers, 
video annotations had negative impact on reading 
comprehension in both Ariew and Ercetin’s study 
(2004) and Sakar and Ercetin’s study (2005). This 
suggests that video may be distracting (or perhaps 
it draws too much attention to itself) and should 
not be used in hypermedia materials. 
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Mayer’s modality principle suggests that 
multimedia information may have deleterious 
effects when a single channel is overloaded. This 
explanation seems plausible in case of videos be- 
cause the visual channel is overloaded with verbal 
visual information received from the text and 
nonverbal visual information received from the 
videos. Another explanation that the theory pro- 
vides is the “redundancy effect” that might have 
occurred by presenting text and videos together. 
The reader has to process the verbal informa- 
tion received from the text through the eyes and 
from the narration in the videos through the ears 
along with nonverbal information received from 
the videos. This might have distracted the learn- 
ers. It also may be possible that the intermediate 
readers did not know how to extract information 
from the annotations and thus wasted time by 
accessing them indiscriminately. As Chun and 
Plass (1997) suggest, the learner “may not have 
enough executive resources to comprehend the 
foreign language and all the information given” 
(p. 66) in the annotations. 

According to Mayer’s modality principle 
(2001), when words and pictures are both presented 
visually, the visual/pictorial channel can become 
overloaded but the auditory/verbal channel is un- 
used. When words are presented auditorily, they 
can be processed in the auditory/verbal channel, 
thereby leaving the visual/pictorial channel to 
process the pictures. 

Another finding that should be emphasized 
is that Ariew and Ercetin (2004) found no re- 
lationship between annotation use and reading 
comprehension for advanced ESL learners which 
was in line with the findings of Davis and Lyman- 
Hager (1997). This finding also was confirmed by 
Akbulut in the 2005 study, which was conducted 
with advanced EFL learners. As demonstrated by 
Ercetin (2003) intermediate level learners rely 
heavily on annotations for text comprehension 
while advanced learners use annotations only 
when necessary. Thus, advanced level learners 
may use their own cognitive resources for text 
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comprehension instead of relying on annota- 
tions. 

The role of proficiency also was emphasized 
by Cooledge’s (2004) study, where readers who 
scored higher on the F-CAPE scored better on 
the comprehension tasks. On the other hand, the 
role of prior knowledge was investigated in Ariew 
and Ercetin’s study (2004), and the study revealed 
that prior knowledge was a significant predictor of 
reading comprehension for the intermediate group 
whereas it was not for the advanced group. 

Even though these annotations may not nec- 
essarily facilitate L2 reading comprehension, 
learners still perceive easy access to annotations 
highly useful in helping them cope with an L2 
text. The participants in both Ariew and Ercetin’s 
study (2004) and Sakar and Ercetin’s study (2005) 
seemed to find all the annotations, including the 
video annotations, useful. However, easy access 
may lead them to use the annotations excessively 
to look up even familiar information (Aust et al., 
1993). Moreover, learners may select to view 
aids not because they are important but because 
they are interesting (Chun & Plass, 1997). Thus, 
provision of additional input using a variety of 
presentation modes may lead to “redundancy” 
and “split attention” effects (Mayer, 2001) and 
may thus hamper reading comprehension at lower 
levels. Thus, studies conducted using the template 
suggest that the design and implementation of 
hypermedia or hypertext materials are important 
factors inreading comprehension. The manner of 
access of annotations, their presentation and the 
way the software behaves may have an impact on 
readers’ comprehension. In addition, other factors 
including learners’ personality profiles also may 
impact reading comprehension. 
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KEY TERMS 


Annotation (Gloss): Information provided 
for the reader to help in comprehension of the 
material. 


Extra-Textual Annotation: An annotation of 
a concept included in the text but not actually ap- 
pearing in it such as background information. 


Hypermedia: An extension of the term hyper- 
text that includes the use of graphics, audio and 
video in addition to textual information. 


Hypertext: A user interface that is used to 
display documents that include cross references 
and links to other documents (hyperlink). 


Multimedia: Using several media (text, audio, 
video, graphics) to convey information. Multi- 
media is used in this case to annotate foreign or 
second language texts for the purpose of making 
them more understandable. 


Template: A ready-made programming struc- 
ture thatis used in this case to create a multimedia 
annotated text. 


Textual Annotation: An annotation of aword 
appearing in the text. 
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Chapter V 
Application of Online 
Questionnaires in 
Grammar Teaching 


Leo Kam-hung Yu 
Hong Kong Baptist University, Hong Kong 


ABSTRACT 


The consciousness-raising approach to grammar teaching aims to provide opportunities for students to 
identify some grammatical components through noticing activities and then make their own hypotheses 
about those components. This chapter proposes the application of the WebCT questionnaire to develop 
outside-class activities through which students are able to test and refine their hypotheses in order to 
internalize the grammar rules. It was found that students were more motivated and participated in the 
activities of testing and refining their hypotheses than in the past. Besides, students were exposed to more 
interlanguage samples that might have helped them refine their hypotheses. It is hoped that this chapter 
gives teachers better understanding of the needs of Chinese university students in grammar learning 
and offers them some innovative and effective teaching ideas in grammar teaching. 


INTRODUCTION 


Hedge (2002) states that grammar teaching is 
“substantially influenced by the input hypoth- 
esis and the notion of intake” (p. 146). There are 
several steps which constitute successful acquisi- 
tion of grammar: (a) noticing, (b) reasoning and 
hypothesizing, (c) structuring and restructuring, 


and (d) automatizing. One simple way for teachers 
to ascertain if students have mastered a specific 
grammatical constituent is to ask students to use 
the target language to achieve some communica- 
tive purposes, for example, asking for direction. 
It is not uncommon to find that what students 
actually master is not what teachers expect them 
to. Furthermore, it is sometimes hard to motivate 
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students to take part in both stages of reasoning 
and hypothesizing, structuring andrestructuring, 
especially in the second language classroom of 
Chinese learners due to the “face” system in Chi- 
nese culture. Students perceive making mistakes 
in front of the class as losing face. Yet making 
mistakes at these stages is unavoidable. So, they 
prefer to remain silent. 
The objectives of this chapter are to: 


a. Report the advantages of introducing the 
WebCT questionnaire tool to support gram- 
mar teaching in an undergraduate English 
proficiency course, with particular empha- 
sis on how to motivate Chinese university 
students to be engaged in both stages of 
reasoning and hypothesizing, and structur- 
ing and restructuring in grammar learning, 
and 

b. | Examine the potential benefits ofthe WebCT 
questionnaire tool for university teachers in 
grammar teaching. 


There are three parts in this chapter. In the 
first part, both the product and the process ap- 
proaches to grammar teaching are discussed. 
Towards the end of part one, the author has at- 
tempted to categorize the steps found in each 
of these approaches into three main domains: 
Exploring, Learning and Acquiring Cycle, and 
Internalizing. Furthermore, the role that the ques- 
tionnaire tool played in the three domains in the 
study will be discussed. In the second part, eight 
design principles are proposed, followed by the 
rationale for the design of the lesson plan in the 
study to demonstrate the interplay between the 
use of the online questionnaires and the noticing 
activities conducted in the class. Implications for 
both students and teachers discussed in part three 
conclude this chapter. 


BACKGROUND 


The first part of this section discusses the inte- 
gration of the product and the process perspec- 
tives of grammar teaching while the second part 
introduces the three main domains in grammar 
teaching, as proposed by the author. 


Integration of Product and Process 
Perspectives 


The product perspective of grammar teaching 
separates the target language into isolated items 
and the emphasis is put on the correct production 
of language forms and structures of the target 
language by students. The Presentation, Prac- 
tice and Production (or the PPP) model, being a 
member of this perspective of grammar teaching, 
has been criticized because of its assumptions 
of language and language learning (e.g., Lewis, 
1993; Scrivener, 1996; Woodward, 1993). The PPP 
model divides the language into segments to be 
taughtinasequential order (Ellis, 1988). However, 
Lewis (1993) argues that language learning is 
not a linear process, and students do not learn in 
a linear way (Willis, 1990). Willis (1990) points 
out that it is not easy to anticipate what students 
have already mastered and what is still absent 
in their memory. So, if students are at different 
stages in the learning process, they will be focus- 
ing on different forms and meanings at any one 
time (Prabhu, 1987). The process perspective, 
however, focuses on the learner and the learning 
process, instead of the language. It encourages 
students to recognize language patterns on their 
own, and then to experiment with the language 
through some learning tasks, which are purely 
communicative with a focus on meaning but not, 
forms. This perspective also has been questioned 
because the accuracy issue is not well addressed. 
Hadley (2002) agrees that “too much of a focus 
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upon meaning will bring early gains in the lan- 
guage learners’ ability to get their ideas across, 
but over time, many fail to move to a higher level 
of proficiency.” Long (1997) lists five possible 
problems of this perspective and concludes that 
a pure focus on meaning is inefficient. 

Since both approaches have their own benefits 
and shortcomings, Batstone (1995) thus integrates 
the two perspectives into his proposed model 
known as “teaching grammar as skill.” Instead 
of deductively showing students the linguistic 
features of the target language, the model adopts 
an inductive approach which encourages students 
to work out the features on their own. Inthe model, 
there are three key phases, namely noticing, struc- 
turing and proceduralization. The model is said 
to “help learners make the leap from the careful 
control of grammar, while working on tasks which 
retain an emphasis on language use” (p. 53). Simi- 
larly, in the Illustration — Interaction — Induction 
model presented by McCarthy and Carter (1995), 
Illustration refers to the examination of the forms 
of authentic data relative to context and use. In 
the Interaction stage, students are engaged in 
the activities focusing on interpersonal uses of 
language and the negotiation of meanings. It is 
hoped that learners’ awareness of these interactive 
properties would be raised through observation 
and class discussion. Induction aims to encourage 
learners to make their own conclusions on the 
interpersonal functions of different lexico-gram- 
matical options, and to develop the skill to notice 
such features in the language learning. 

Lewis (1996) proposes another inductive 
paradigm called Observe —Hypothesize—Experi- 
ment. In the model, Students are exposed to some 
language samples in order that they first observe 
the pattern, andthen make hypotheses on the form, 
meaning and use. Afterwards, students experi- 
ment the language that they have observed and 
hypothesized to meet some real communicative 
needs. Hedge (2002) suggests that the learning of 
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grammar involves four stages namely noticing, 
reasoning and hypothesizing, structuring and 
restructuring, and automatizing. 


The Three Domains 


The authors in the four models shown in the pre- 
ceding part are using different terms to refer to 
similar concepts. Itis necessary to standardize the 
terms used in this research. Thus, this research is 
based on my model of grammar teaching, which 
synthesizes the different authors’ approaches 
into three main domains, Exploring, Learning 
and Acquiring Cycle and Internalizing, as shown 
in Figure 1. 


The Exploring Domain 


Unlike the deductive perspective in which 
grammatical constituents are shown to students 
explicitly, the exploring domain adopts the induc- 
tive perspective that the role of the teacher is to 
provide language data for students to work out 
the grammatical patterns on their own. This can 
be conducted as individual, pair or group work. 
This approach is similar to that of the conscious- 
ness-raising method (Ellis, 1993; VanPatten & 
Cardierno, 1993). 


The Learning and Acquiring Cycle 


According to the Acquisition/Learning Hypoth- 
esis of the Natural Approach proposed by Krashen 
(1982), there is a distinction between acquiring 
and learning a language. Acquisition is an uncon- 
scious process in which language proficiency is 
achieved by understanding language and using 
language for meaningful communication. On 
the other hand, learning is a conscious process 
which emphasizes “explicit knowledge about the 
forms of a language and the ability to verbalize 
this knowledge” (Richards & Rodgers, 1994, 
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Figure 1. The three domains of grammar teaching 


Models Step 1 Step 2 Step 3 Step 4 
Step 2 (in 3-step models) Step 3 
(in 3-step models) 
‘Batstone (1995) Noticing Structuring ~- Proceduralization 
: ene ee 
| Carter(1995) 2 
: Lewis (1996) Observing Hypothesizing Experimenting 
; .Hypothesizing Restructuring 
Domains: Exploring Learning and Acquiring Cycle Internalizing 


p. 131). Therefore, there is no causal relation- 
ship between learning and acquisition, that is, 
acquisition is not the result of learning. Harmer 
(2001) criticizes this view by arguing that if a L2 
learner can produce language correctly, it is hard 
to know whether he/she is able to because they 
have consciously monitored their language before 
production or he/she picked it up somewhere in the 
target language context. Thornbury (2000) sup- 
ports Harmer’s idea by stating that “the learner’s 
role is perhaps less passive than Krashen implies, 
and that acquisition involves conscious processes, 
of which the most fundamental is attention” (p. 
24). So, noticing the language items may help 
learners acquire the items. In this regard, this 
chapter combines these two concepts together to 
form the second domain, which the author calls 
the “learning and acquiring cycle.” 

The learning and acquiring cycle encapsulates 
the steps that follow the noticing activities. These 
include structuring (Batstone, 1995), interac- 
tion (McCarthy & Carter, 1995), hypothesizing 


(Lewis, 1996), reasoning and hypothesizing, and 
structuring and restructuring (Hedge, 2002) 
activities from the different models in Figure 1. 
In other words, all activities aim to help learners 
generalize what they have observed in the notic- 
ing or observing activities of the first domain, 
and then modify their generalizations. The term 
“cycle” represents the complex and re-occurring 
process of generalizing and modifying hypotheses 
in the learners’ mind. 


The Internalizing Domain 


Once learners have gone through the learning 
and acquiring cycle to produce language items 
which are compatible with the ones produced 
by native speakers, learners are deemed to have 
internalized the target language items. In other 
words, this could simply be the case that they 
can use the language to achieve a communicative 
purpose effectively. 
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DESIGN CONSIDERATIONS 


This section is divided into two parts. The first 
part outlines eight design principles employed 
by the author in the study. Moreover, the role the 
WebCT questionnaire tool played in the study is 
also discussed. Having Eisenstein’s (1987) six 
parameters of lesson planning as the conceptual 
framework, the second part explains how the 
in-class and outside-class activities of the study, 
which fell into three different stages, were con- 
structed. 


Design Principles 


Richards and Rodgers (1994) propose that “in 
order for an approach to lead to a method, it is 
necessary to develop a design for an instructional 
system” (p. 20). Bearing the consciousness-raising 
approach to grammar teaching in mind, eight de- 
sign principles of the study are as shown below: 


Objectives of the method 

Focus of the material 

Various question types 
Socio-cultural awareness 

Intrinsic motivation 

Easy accessibility for participants 
Equal opportunity for participation 
Training for students 


So me panos 


Objectives of the Method 


In the design process, it is necessary to consider 
what the objectives of a method are (Richards 
& Rodgers, 1994). The study aims to motivate 
Chinese university students to be engaged in 
both stages of reasoning and hypothesizing, and 
structuring and restructuring in grammar learn- 
ing or the Learning and Acquiring Cycle domain 
in Figure 1. It is proposed that through effective 
engagement in these stages, students are able to 
test and refine their interlanguage without losing 
their face. The purpose of adopting the online 
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questionnaire is to encourage students to take 
part in the second domain “learning and acquir- 
ing cycle” and to test and refine their hypotheses 
through answering the MC type questions and 
some open-ended questions. In other words, the 
objective of using the online questionnaire is 
to encourage students to participate actively in 
the Learning and Acquiring Cycle domain and 
therefore, accuracy in the use of the language is 
not essential at this stage. Students had been told 
about this fact by the teacher before they started 
completing the questionnaire in order to ease their 
worries or to lessen their frustration. 


Focus of the Material 


One way to ascertain if students have acquired 
a specific grammatical constituent is whether 
they can use the target language to complete a 
learning task in which practical communicative 
objective is to obtain information. Moreover, the 
material should be “understandable, relevant, and 
[contains] interesting exchanges of information, 
rather than on the presentation of grammatical 
form” (Richards & Rodgers, 1994, p. 25). Practical 
communicative values were found in some of the 
questions set in the questionnaire. For example, 
the context used in one of the tasks used in the 
study was whether Mary would or would not go to 
the Christmas Ball with Paul. This task calls for 
the use of conditional sentences (see Appendix 1). 
By using the second type of conditional sentence, 
students would be able to refer to things which 
are not true or not possible to happen at the time 
of speaking or in the future (Source: University 
of Victoria, available at http://web2.uvcs.uvic. 
ca/elc/studyzone/410/grammar/2cond.htm).The 
sentence “If I went to the ball, I would call you 
tonight” suggests that the speaker does not intend 
to goto the ballin future. Itis impossibility. There- 
fore when a female student says this, she would 
know how she has just indirectly refused a boy’s 
invitation to a party in English. If a male student 
hears this, he would know that his invitation is 
politely rejected by a girl in English. 
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Various Question Types 


The simplest form of questions is the multiple 
choice (MC) type of questions because the scor- 
ing is direct, quick and economical. But, there 
are disadvantages using MC questions (Hughes, 
1997). For example, students may guess the answer 
by randomly choosing an option from the avail- 
able ones. Besides, MC items require detractors 
but sometimes it is hard to write enough good 
detractors. Another disadvantage is that MC items 
restrict what is supposed to be tested because all 
answers need to be fixed beforehand. The nature 
of the study is to encourage students to participate 
in the task to test and refine their interlanguage, 
so the form of questions employed to encourage 
hypothesis testing should be more open-ended. 
However, in this study MC items were used as a 
warm-up exercise, in the form of sample questions, 
before students were exposed to an open-ended 
short question which requires high ordering skills 
such as reasoning. 


Socio-Cultural Awareness 


Socio-cultural factor is an aspect of the affective 
domain of second language acquisition as sug- 
gested by Brown (1994). In view of the “face” 
system in Chinese culture, Chinese students 
perceive making mistakes in front of the class 
as losing face. Yet, making mistakes in language 
learning is unavoidable. So, most weak students 
prefer to remain silent. The online questionnaire 
tool, which allows a student’s identity to remain 
anonymous, provides an excellent vehicle for 
students to test their interlanguage without losing 
face when they make mistakes. 


Intrinsic Motivation 
Motivating students to participate in outside-class 


activities is not an easy task. One major benefit 
for choosing the online questionnaire tool is that 


students might be motivated to apply what they 
have observed in the noticing activities in the ex- 
ploring domain in Figure 1 because, as suggested 
by Biggs and Watkins (1995:91), intrinsic interest 
is created and maintained by questioning since 
“questions open up knowledge; they arouse and 
maintain curiosity.” In other words, in an online 
environment, students have time to think when 
answering the questions in the questionnaire. 
Second, their identities remain anonymous. In 
other words, even they make mistakes, no one 
knows. More importantly, students will not lose 
face when making mistakes. It is thus believed 
that the online questionnaire might create curi- 
osity, and this eventually motivates students to 
keep on formulating, testing and refining their 
hypotheses about the target language. When 
setting up the questionnaire for each unit, the 
author tried to limit the task time for each task 
to about 15 minutes. If it took too much time for 
students to complete the questionnaire, they might 
have been de-motivated to take part in the task. 
However, there was no time limit set for each 
questionnaire. Students were allowed to spend 
more than 15 minutes for the task if they wanted 
to. Furthermore, students can return and redo the 
tasks if they wished to. 


Easy Accessibility for Participants 


Accessibility is another important issue espe- 
cially when students are asked to complete some 
outside-class activities on the Internet (Pearson 
& Koppi, 2003). It is expected that students may 
become less reluctant to take part in the activity 
if the way of accessing the activity is convenient. 
Since the questionnaire was available on WebCT, 
all students were able to gain access to the ques- 
tionnaire on WebCT anytime, anywhere with 
their computers at homes or halls of residence. 
The teacher was able to create questionnaire 
tasks, modify the questions, and keep track of the 
response rate and so on around the clock. 


69 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Application of Online Questionnaires in Grammar Teaching 


Equal Opportunity for Participation 


In the traditional classroom, high achievers and 
active students are more eager than low achiev- 
ers to answer questions (Biggs & Watkins, 
1995). Besides, because of time constraints, the 
teacher is unable to provide opportunities to all 
students to answer questions in class. The online 
questionnaire, however, allows all students, no 
matter whether they are high achievers or not, 
to participate in outside-class activities at their 
own pace and time provided that the submission 
deadline is observed. 


Training for Students 


To familiarize students with the operation of the 
questionnaire tool of WebCT, a short demonstra- 
tion was conducted to all students in a computer 
laboratory. After the demonstration session, all 
students were required to complete a short ques- 
tionnaire to make sure that they knew what to 
do. An instruction sheet also was posted on the 
WebCT course room for their reference. Students 
were reminded that it was better for them to save 
the answer of a question before moving on to 
the next. They were also allowed to change their 
answers before submission. 


Role of the Online Questionnaire 
Tool 


As discussed in the previous section, one problem 
the author encountered was that students were 
reluctant to speak up in class because making 
mistakes made them lose face. As a result, they 
were unable to test and refine their hypotheses 
about the target language. However, making 
mistakes, as Cook (2001) rightly points out, is a 
natural part of the learning process. 

Having this constraint in mind, the author 
introduced the use of online questionnaires to 
overcome this problem. The question types used 
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in the study comprised both multiple-choice and 
short-answer questions. All questionnaires were 
created, maintained and managed by the WebCT 
questionnaire tool. WebCT is an online learning 
environment through which students are able to 
gain access to course information at home or in 
the university provided that their computers are 
connected to the Internet. 

The questionnaire tool was easy to operate 
because the teacher was able to create, edit, and 
maintain the questionnaire, and generate a result 
reportjust by pressing a few buttons. The platform 
allowed the teacher to post challenging questions 
as a follow-up to the noticing activities in class 
so that students could use the questions to test 
and refine their hypotheses. Since their identity 
remained anonymous inthe result report, students 
did not lose face in front of their classmates even 
when they made mistakes in the questionnaire. 


The Lesson Plan 


Eisenstein (1987) states the importance of con- 
sidering learners’ backgrounds and needs when 
making pedagogical decisions about grammar 
instruction. The following six parameters pro- 
posed by Eisenstein were taken into consideration 
when the author designed his lesson plans. The 
lesson plans, in addition to the activities conducted 
during the class, included some pre-class and 
post-class activities. 


Eisenstein’s Parameters 


The first one of Eisenstein’s parameters used in 
the design of the grammar activity was explicit 
grammatical explanations. Since the students 
were advanced learners who had learnt English 
for some 13 years, the method of conscious gram- 
matical explanations, according to Eisenstein’s 
model, was adopted. 

The second parameter was isolation of gram- 
matical rules. Eisenstein believes that learners 
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Table 1. Tasks and purposes in the three stages of the lesson plan 


STAGES 

1. Pre-class (Home preparation) 

Purposes: 

(i) To expose students to language input through 
noticing activities 

(ii) To help students formulate generalizations on 
some language patterns on their own 


TASKS 

- Before going to class, every student was expected to: 

1.1 Study the language input (i.e. examples) and 

1.2 Complete questions in each part of a unit 

- Members of a presentation group, in addition to the 

above tasks, were required to: 

1.3 Describe and discuss some grammatical 
components mentioned in a unit that they thought 
useful and relevant to their interest and competence 
level 

1.4 Relate the grammatical concept to real life 
examples as many as they could 


2. During class 

Purposes: 

(i) To revisit what students learned in the previous 
unit 

(ii) To offer opportunities for students to use 
metalanguage to discuss language problems with 
others 

(iii) To let students (i.e. presentation group members) 
present their generalizations in front of the class 

(iv) To allow students to learn from others, in addition 
to the teacher 

(v) To isolate grammatical rules for the sake of 
students’ easy understanding 

(vi) To give explicit grammatical explanations to 
students 

(vii) To use explicit grammatical terms to help 
students refine their generalizations 


- In Review of survey results, the teacher 

2.1 showed students the survey result (from the online 
questionnaire) 

2.2 asked students to comment on the results 

2.3 asked students to work in groups or pairs for 
discussion 


The students were expected to: 

2.4 spot and correct the errors 

2.5 explain the errors by using metalanguage as much 
as possible 


- In group presentation, 

2.6 members of the presentation group performed the 
tasks shown in 1.3 & 1.4 above 

2.7 the teacher acted as a facilitator only 


- In class discussion, the teacher 

2.8 highlighted key grammatical concepts of a unit by 
using grammatical terms explicitly 

2.9 gave a preview of the questions on the online 
questionnaire that students needed to complete 
after class 


3. Post-class 

Purposes: 

(i) To test students’ grammatical knowledge 

(ii) To allow students to produce interlanguage 
output 

(iii) To obtain interlanguage input for analysis and 
discussion in tasks 2.1 —2.5 


3.1 After class, students were required to complete an 
online questionnaire 
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may find conscious statements of grammatical 
rules and structures useful because explicit lan- 
guage knowledge, as suggested by Ellis (1990), 
helps learners get exposed to specific linguistic 
features during the instruction input, and even- 
tually, this will lead to the incorporation of the 
elements into the target language. 

A combination of inductive and deductive 
presentations of grammar points was the third 
parameter adopted in the study. An inductive 
presentation was given at the beginning of the 
lesson to help students recall the generalizations 
that they had made in home preparation. Deduc- 
tive presentations were used to explain the errors 
students made on the online questionnaire and to 
summarize the key grammatical concepts at the 
end of each class. 

The fourth one was the rule explainer, which 
emphasizes the opportunity for students to state 
the rule. This parameter was found problematic 
in the study because in some cases, students were 
reluctant to contribute. This could be explained 
by the fact that students did not want to lose face 
in front of their classmates. 

Use of grammatical terms was the fifth pa- 
rameter. The use of grammatical terms or ter- 
minologies enables students to explain concepts 
more easily. Grammatical terms were used by the 
teacher but the use was kept minimal in order not 
to confuse the students as they only achieved a 
passing grade “E” in their Use of English examina- 
tion. Although it was not compulsory for students 
to use grammatical terms when expressing ideas, 
they were highly encouraged to do so. 

The sixth and the final parameter was the me- 
dium of explanation. An answer key with detailed 
written explanations of the grammatical concepts 
of a unit was distributed to students at the end of 
each lesson to reinforce the spoken explanations 
given by the teacher during class. 

In the course, students were given a set of 
course books, made up of 11 units, which touched 
onthe errors that students frequently made accord- 
ing to a needs analysis carried out by the course 


72 


coordinator before the course began. There were 
three stages to completing each unit. First of all, 
before going to class, students were required to 
do some preparation at home (i-e., stage 1). Then, 
during the class (i.e., stage 2), the teacher, who 
played the role as a facilitator, guided students 
in the discussion on the grammatical topic of the 
week since class discussion is an inductive activity 
in the stage “interaction” (McCarthy & Carter, 
1995, p. 4). After class (i.e., stage 3), students 
were asked to complete an online questionnaire 
before attending the class the following week. 
The following week, the teacher went over the 
questionnaire by drawing students’ attention to 
the survey result and asking students to comment 
on it. Table 1 gives an overview of the tasks and 
the purposes in each of the three stages. 


Pre-Class Stage 


Before going to class, students were expected to 
go through a specified unit on their own. In each 
unit, there were several parts. Each part consisted 
of some language data or examples and students 
were asked to make some generalizations before 
moving on to the next part (i.e., the inductive pre- 
sentation). This is a kind of scaffolding activity 
to help students build their knowledge on what 
they had learnt in the past and on what they had 
noticed in the previous activity. 


During Class Stage 


There were three main class activities, namely 
Review of survey results, Group presentation 
and Class discussion (except for the first class, 
where the first activity was absent). The Review 
of survey results phase aimed to revisit the ques- 
tions posted on the online questionnaire and 
discuss some key grammatical components. The 
teacher showed the results of the questionnaire, 
including both “multiple choice” and “short an- 
swer” question types to students via the “survey 
result” function of WebCT and elicited students’ 
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comments on them. In some cases, the teacher 
asked students to work in groups or pairs to cor- 
rect the errors collected by the teacher from the 
questionnaire. This activity lasted for 10 to 15 
minutes and fulfilled the first two parameters of 
explicit grammatical explanations and isolation of 
grammatical rules, as well as the fifth parameter 
of use of grammatical terms. 

Following this activity was a group presenta- 
tion. A group of four to five students gave a 10 to 
15 minute presentation on the key concepts taken 
from the course book that they thought important 
and relevant to other students. In addition to this, 
students were encouraged to use some daily life 
examples, such as I Seek You (or ICQ) messages, 
as illustrations in their presentations. This prac- 
tice followed the fourth parameter of the rule 
explainer. In other words, this gives students the 
power to choose their own examples which are 
relevant to their lives. 

Finally, class discussion included highlight- 
ing key grammatical concepts covered in a unit. 
It offers explicit grammar explanations to help 
students internalize the grammatical concepts 
because the practice of giving explicit grammar 
explanations is suitable for advanced learners. 
Furthermore, this activity allowed students to 
build their grammatical knowledge systematically 
through the use of grammatical terms. 


Post-Class Stage 


After each lesson, the teacher posted some ques- 
tions, which were related to the rules that students 
learned in class, onto the online questionnaire. The 
questions tested students’ grammatical knowledge 
by asking them to apply the knowledge in some 
situational context. At the same time, the answers 
that students supplied were the output of their 
learning. These rules and structures, in turn, 
became the input for analysis and discussion in 
the lesson that followed. 


FINDINGS AND DISCUSSION 


This section is divided into two parts. The first part 
elaborates the implications for students while the 
second part concentrates on those for teachers. 


Implications for Students 


There are four possible implications for students. 
This approach: 


. Provides more target language samples, 
generated by the students, as extra explana- 
tions for the correct answer 

° Encourages scaffolding and higher order 
thinking skills 

° Increases students’ expectation of success 

° Encourages students’ active participation 


More Target Language Samples as 
Extra Explanations for the Correct 
Answer 


Take Unit 4 of the course as an example. It was 
about conditional sentences. After the lesson, in 
addition to answering three multiple choice items, 
students were asked to answer an open-ended 
question as follows: 


Q4: Why are there three, not four, types of condi- 
tional sentences, which are “PRESENT-REAL,” 
“PRESENT-UNREAL,” and “PAST-UNREAL.” 
Why is “PAST-REAL ” missing ? How do we express 
the “PAST-REAL” situation? 


Since the interlanguage samples were pro- 
duced by students (c.f. Table 2) and the difficulty 
level of the samples was appropriate for other 
students of the same course, they could act as 
inputs for analysis and discussion in the lesson 
that followed. 
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Scaffolding and Higher Order Thinking ing principle, in which students construct their 
Skills Employed own learning by building new knowledge on what 
they have mastered (Hoover, 1996). 

It is evident that some students refined and Besides, while the students were testing and re- 
tested their hypotheses by applying their previ- fining their hypotheses, they were practicing their 
ous knowledge. Table 2, for example, showed that higher order thinking skills, such as critical and 
some students tried to describe and explain the analytical skills, when elaborating why there was 
“PAST REAL.” situation (which was the “new” no “past-real” conditional sentence. For example, 
knowledge) by the simple past tense (which was Student#14 questioned the situation by saying “is 
the “old” knowledge). This practice of building it the ‘past-real’ is a fact not conditional?” His 
“new things” on “old things” echoes the scaffold- sentiment was echoed by Student#20. 


Table 2. Student responses on Question 4 of Unit 4 


UserID |Response 


1 The “Past-Real” situation is impossible because when we say that “if I went to the ball, I will call u” 
that means it is impossible to go the ball. 
2 It is difficult to say that the possible event will occur later in the past. The past-real situation can be 


expressed to something are possible occur in the past after the previous event happened, but it is not 
sure that it is really happened. 


3 I think “PAST-REAL” has the same meaning of “Simple Past,” so the sentence sould express this 
way: “I went to the ball with you.” 

4 there is no past-real form in tence struction 

6 Mary went to the ball with Paul last night. 

7 If the past real exist, e.g. If I went to school last night. you would......so this has changed to “past 


unreal.” The past real is missing, becaus the things happened in the past has been a fact which you 
can’t change. 


8 use past tense only 

9 The Past-real formation cannot be show in conditional sentence, for the thing happened actually in 
the past and needn’t to suppose something, so in my opinion, past -real is just the same as past tense 
sentence. 

11 If I had gone to the ball, I would call you last night. 

12 fas 

13 People will use simple past tense to discribe the past real action 

14 is it the “past-real” isa fact not conditional? 

15 If (present tense), (present tense). 

17 It is impossible to have PAST-REAL situation because the past become the fact that must be true or 
you are going to tell lie. 

18 because past things can’t change anytime! 

20 “PAST REAL.” is missing because if something happened, no need to use contional senctence to 


assume it. Use simple past tense to express the “PAST REAL” situation. 


* All the response above was taken from the result report without any modifications to maintain originality. 
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Expectation of Success 


Another benefit is that students’ expectation 
of success can be increased. According to the 
expectancy value theory of motivation (Biggs & 
Watkins, 1995, p. 83), students will participate 
in an activity if they perceive the value behind it 
and if they can expect success. Some pedagogical 
steps were taken in this research to help students 
realize the value of participating in the online 
questionnaire activities. First of all, in terms of 
extrinsic motivation, students in this study were 
encouraged to apply what they learnt from lessons 
and the course book so that they could ascertain 
whether they had grasped the ideas or not. If they 
had been unable to do so, they might have had 
to repeat the course in the second semester. In 
terms of intrinsic motivation, apart from arous- 
ing students’ curiosity in the ways mentioned in 
the previous section, students would also have 
expected to improve their English language pro- 
ficiency to meet their academic needs. This also 
could strengthen their instrumental motivation 
in terms of “learning the language for a career 
goal or other practical reason” and integrative 
motivation in terms of “learning the language 
in order to take part in the culture of its people” 
(Cook, 2001, p. 114). 

In order to help students become intrinsically 
motivated, it was necessary to ensure that the 
difficulty level of the tasks was appropriate for 
the students. The author acknowledges that this 
was not an easy task. One criterion that was taken 
into consideration was to observe the concept of 
“positive intrinsic motivation” (Biggs & Watkins, 
1995, p. 95), which is to ensure that there is a 
mixture of familiar and unfamiliar tasks so that 
curiosity can contribute to challenging and mo- 
tivating tasks for students. In the examples taken 
from unit 4, the familiar task was to ask students 
what the three types of conditional sentences 
were. The author deliberately did not cover the 
hypothetical one (the “past-real” type) in class 
because that type of conditional sentence does 


not exist in English. Through the tasks, students 
were challenged and asked to build on what they 
had already learnt in order to answer the teacher’s 
questions. Student responses, as revealed from 
Table 2, showed that the task was not too difficult 
because some students were able to answer the 
questions by referring to their previous knowledge. 
For example, some explained that there was no 
“past-real” conditional sentence because the past 
tense should be used instead. 


Active Participation 


There were some 46 students enrolled in the 
author’s class and 38 of them answered the 
evaluation questionnaire (see Appendix 2), which 
was distributed in the last session of the course. 
Among the 38 subjects, nearly 90 percent of 
them (34 subjects) reported that they completed 
at least one questionnaire activity (there was one 
questionnaire activity per unit). Slightly less than 
one-fifth (16 percent) of the subjects (6 subjects) 
were active participants, having completed five 
questionnaire activities or more. 

Regarding student perception of the use of 
the online questionnaire to learn grammar, over 
80 percent of the participants reported that the 
use of the online questionnaire had stimulated 
their interest in learning grammar (84 percent), 
allowed them to reflect on what they had learnt 
during the class (89 percent) and allowed them 
to deepen their understanding of a particular 
grammar point (89 percent). Finally, a majority 
of subjects found that the questions were chal- 
lenging (78 percent) and that the difficulty level 
of the questions was appropriate (83 percent). 
Ultimately, they recommended that this mode 
of teaching and learning should be promoted in 
the future (89 percent). (For details of the reasons 
for whether taking part in completing the ques- 
tionnaires or not, please refer to Appendix 3). 
An indirect benefit was that students, especially 
low achievers, were encouraged or motivated to 
participate in the discussion since all submissions 
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were anonymous and hence avoided unnecessary 
embarrassment. Thus, the issue of losing face 
in the Chinese culture was overcome. This is 
something that would be impossible in traditional 
face-to-face in-class discussions. 


Implications for Teachers 


There are six possible implications for teachers, 
which include: 


. Ascertaining what students have mastered 

. Explanatory notes composed by students 

. Collection of authentic interlanguage 
samples 

. Summative statistics formodifying teaching 
materials 

° Promoting of deep learning 

. Characteristics of emerging pedagogy 


Ascertaining What Students Have 
Mastered 


Having more opportunities for students to test 
and refine their grammatical hypotheses means 
more interlanguage samples can be collected. 
The samples will thus help solve the problem 
mentioned in the introduction — “what students 
actually master is not what we expect them to.” 
In other words, the teacher will be able to identify 
the gap between the new knowledge being taught 
and the knowledge students have acquired in the 
scaffolding process of learning. 


Explanatory Notes Composed by 
Students 


Interlanguage samples produced by students can 
also be put to pedagogical use. The correct samples 
can be treated as grammar explanations to help 
the teacher explain the new grammar item(s) to 
students. For example, the teacher may be tempted 
to use some linguistic terminologies to explain a 
new grammar item to students but students may 
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find it too difficult to understand. Instead, the 
teacher can make good use of the “student lan- 
guage” embedded in the interlanguage samples 
to explain the new item(s) to students. 


Collection of Authentic Interlanguage 
Samples 


The third benefit is that learners’ output on the 
online questionnaire could be used asthe language 
input for discussion in class (i.e., Tasks 2.1-2.5 in 
Table 1) because learners’ sentences are reflec- 
tions of their temporary language systems (Cook, 
2001). The output revealed the competency level 
of the grammatical knowledge of notjust a limited 
number of students (as a result of the traditional 
practice of asking students to answer questions 
individually) but of a relatively larger number of 
students or even the whole class provided that 
they all completed the questionnaire before go- 
ing to class. 


Summative Statistics for Modifying 
Teaching Materials 


The questionnaire function of WebCT enables 
teachers to perform some statistical analysis by 
just a few clicks (see Table 3). For example, in 
Question 2 (Q2), which was about second-type 
conditional sentence, 10 out of 21 students got the 
correct answer “D.” Five students chose B, another 
five students chose C, and one student chose A. 
Teachers then can conduct item analysis to obtain 
the difficulty level of each item by the facility 
values (“the proportion of students responding 
correctly to an item’) (Hughes, 1997) (e.g., [10/21] 
= 48 percent chose “D” for Q2). Also, the teacher 
can find out the performance of the detractors to 
see whether they should be replaced by better 
ones. As revealed from Table 3, the students have 
not yet mastered what second-type conditional 
sentence is. The teacher is thus able to realize 
students’ needs and to make adjustments to the 
teaching material accordingly. 
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Promoting Deep Learning 


Theteacher is able to promote deep learning in the 
classroom. For example, correct target language 
samples produced by students can be treated as 
explanatory notes for students. The incorrect 
samples can be used by the teacher as examples 
to stimulate group discussion. Through this ap- 
proach, itis necessary for students to practice their 
critical and analytical skills through self-reflection 
and in group discussions. In actively participating 
in group discussions, students’ misconceptions are 
confronted. Students also are able to relate new 
grammatical concepts to what they have already 
known and understood in their attempt of trying 
to explain why the samples are wrong. Besides, 
students are motivated to keep on formulating, 
testing and refining their hypotheses through 
questioning because it creates curiosity, and their 
intrinsic interest is created and maintained (Biggs 
& Watkins, 1995). More importantly, students are 
allowed to make mistakes without penalty. These 
are all characteristics of deep learning proposed 
by Entwistle (1988), Biggs (1999), and Ramsden 


Table 3. Detailed statistics summary: Unit 4 


(2003), to help students deepen their understand- 
ing over time. 


Characteristics of Emerging Pedagogy 


The design of the study is in line with the five 
pedagogical aspects, namely active, collaborate, 
creative, integrative and evaluative, of Emerging 
Pedagogy (Voogt & Odenthal, 1997; Wijnen, 
Zuylen, Mulders, & Delhoofen, 1999). See Table 
4. It is believed that this new pedagogy enables 
“complex learning environments” to take place 
and more interactions between the teacher, the 
student, curriculum content and goals as well as 
the materials to be available (Voogt, in press). 
When compared with the traditional pedagogy, 
the students in the study were able to (a) determine 
their learning pace (active), (b) work in teams of 
mixed ability to help each other (collaborative), 
(c) produce learning products (creative), (d) prac- 
tice grammatical constituents learnt in the class 
through some thematic exercises in the form of 
questionnaires (integrative), and (e) realize their 
weaknesses through feedback from the teacher 
and other students and results from the question- 
naire (evaluative). 


Title N Frequency Mean SD Median Mode 
- a(1) |b(2) |c(3) |d(4) 
Unit 4:Q1 | 21 0 3 10 7 1 2.29 0.78 2.0 2 
Unit 4.Q2 | 21 0 1 5 5 10 3.14 0.96 3.0 
Unit 4.Q3 | 21 0 1 2 1 17 3.62 0.86 4.0 4 


[Note: The table above is generated by WebCT. Not all statistical data are relevant to the teacher. For example, 


since the four choices (A to D) are nominal variables, the figures under mean, SD and median are inapplicable 


for teachers. The reason for incorporating the table here is to show how the summary looks like and to show that 


teachers can obtain necessary statistical data for analysis when needed. ] 
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Table 4. Characteristics in the traditional pedagogy vs. emerging pedagogy (Voogt & Odenthal, 1997; 


Wijnen et al., 1999) 


Aspect Traditional Pedagogy Emerging Pedagogy 
Active Activities prescribed by teacher Activities determined by learners 
Whole class instruction Small groups 
Little variation in activities Many different activities 
Pace determined by the program Pace determined by learners 
Collaborative |Individual Working in teams 
Homogeneous groups Heterogeneous groups 
Everybody for him/herself Supporting each other 
Creative Reproductive learning Productive learning 
Apply known solutions to problems Find new solutions to problems 
Integrative No link between theory and practice Integrating theory and practice 
Separate subjects Relations between subjects 
Discipline-based Thematic 
Individual teachers Teams of teachers 
Evaluative Teacher-directed Student-directed 
Summative Diagnostic 
CONCLUSION their hypotheses on grammatical constituents 


At the beginning of the chapter, the problems 
encountered by the author in teaching grammar 
to undergraduate students were identified. For 
example, it was difficult to motivate students to 
take part in both stages of reasoning and hypoth- 
esizing, and structuring and restructuring because 
Chinese second-language learners perceive mak- 
ing mistakes in front of the class as losing face. In 
this regard, then a review of recent approaches to 
grammar teaching was first conducted before the 
author synthesizes the different approaches into 
three new domains, namely Exploring, Learning 
and Acquiring Cycle, and Internalizing to form 
the theoretical framework of the study. Next, the 
interplay between the questionnaire function of 
WebCT and the outside-class activities following 
the noticing activities in class was examined. It 
was believed that through the online question- 
naire, students were able to freely test and refine 
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covered in the course book. 

The author proposed and employed eight 
principles in the design of the study as a whole, 
and adopted Eisenstein’s six parameters when 
designing the lesson plans for both in-class and 
outside-class activities. Itwas found that there are 
four possible implications for students: (a) more 
interlanguage samples as extra explanations for 
the correct answer, (b) scaffolding and higher 
order thinking skills employed, (c) expectation of 
success, and (d) active participation. There are six 
possible implications for teachers, which include: 
(a) ascertaining what students have mastered, 
(b) explanatory notes composed by students, (c) 
collection of authentic interlanguage samples, 
(d) summative statistics for modifying teaching 
materials, (e) promoting deep learning, and (f) 
characteristics of emerging pedagogy. 

The inductive grammar approach was imple- 
mented and most of the students, who participated 
in the study, reported that the use of the online 
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questionnaire had stimulated their interest in 
learning grammar, and had allowed them to 
reflect on what they had learnt during the class 
and to deepen their understanding of a particular 
grammar point. Moreover, the questions were 
found challenging but the difficulty level of the 
questions was appropriate. As a result, students 
recommended that this mode of teaching and 
learning should be promoted in the future. 
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APPENDIX 1. SAMPLE QUESTIONS 
IN UNIT 4 


Question 1 (answer; b) 
Mary met Paul at the podium in the morning and said “If I go to the ball, I will call you tonight.” 


[2 Mary has called Paul and told him that she might go to the ball with him. 
Cc b. Mary has not yet called Paul but she may go to the ball with him. 
c. It is not certain whether Mary has called Paul or not but she may go to the ball with him. 


Cc 


a d. It is certain that Mary will not go to the ball with Paul. 


Question 2 (answer: d) 
Mary met Paul at the podium in the morning and said “If I went to the ball, I would call you tonight.” 


a. Mary has called Paul and told him that she might go to the ball with him. 
‘o 
GC b. Mary has not yet called Paul but she may go to the ball with him. 
f° It is not certain whether Mary has called Paul or not but she may go to the ball with him. 


d. It is certain that Mary will not go to the ball with Paul. 


Question 3 (answer: d) 
Mary met Paul at the podium in the morning and said “If I had gone to the ball, I would have called you last night.” 


| ne Mary called Paul and told him that she went to the ball with him last night. 
G b. Mary did not call Paul but she went to the ball with him last night. 


c. It was not certain whether Mary called Paul or not but she went to the ball with him last night. 


Cc 


GC d. It was certain that Mary did not go to the ball with Paul. 


Question 4 
As you can see from the PowerPoint, there are three types of conditional sentences, which are “PRESENT-REAL,” 
“PRESENT-UNREAL,” and “PAST-UNREAL.” Why “PAST-REAL.” is missing? How do we express the “PAST-REAL” 


situation? 
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APPENDIX 2. EVALUATION 
QUESTIONNAIRE 


Using an Online Survey to Discuss Grammar Points 


Presented by: https://jafrilibrary.com 


Name: 
Section: 
5 timesor {3-4 times 1-2 times Never 
more 
1. Have you participated in the survey? 
GO TO Q3 (Go to Q2) 
2. The reason(s) for not taking part in the survey: 
3. The reason(s) for taking part in the survey: 
Strongly Agree Disagree Strongly 
Agree Disagree 
4. This mode of interaction (using a survey form) has 
motivated my interest to learn grammar. 
5. This mode of interaction has facilitated my learning 
after the class time. 
6. This mode of interaction allows me to reflect on 
what I have learnt during the class. 
7. This mode of interaction allows me to deepen my 
understanding of a particular grammar point. 
8. This mode of interaction enables me to learn from 
others (e.g. through the survey results). 
9. The instructor has given enough explanations on 
students’ postings 
10. The questions are challenging. 
11. The difficulty level of questions is appropriate. 
12. In short, I will recommend that this mode of 
teaching and learning should be promoted in the 
coming year. 
82 
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APPENDIX 3. REASONS FOR 
TAKING PART OR NOT TAKING 
PART IN THE ACTIVITY 


Question 2: The reason(s) for not taking part in 
the survey 


34. Give opinion 

32. Ihave forgotten to do 

31. I forgot to take the survey 

30. not convenient 

27. don’tknowthe correct answer with explana- 
tion instantly 

22. too details to answer 

17. coz 1am busy and lazy 

13. lazy 

7. Tam lazy 

4.  notime 

2. I was too busy to participate all 


Question 3: The reason(s) for taking part in the 
survey 


38. Test myself 

37. Have a self test 

36. Have a self-test 

35. useful 

33. test myself 

32. it is useful and interesting 

31. It is useful to understand the materials 

29. Training my grammatical skill and doing 
some exercise about the related units 

28. clear concept of grammar / challenging 

23. follow the tutor instruction 

21. express my points 

20. the questions [are] interesting 

19. When I have time, I will do it 

18. have to do so 


17. itis good 

16. I think it is useful and helpful by more fa- 
miliar to the topic. The examples are close 
enough for our common error. 

15. to use what I learned from the section 

14. take more practise 

12. it must be useful 

11. interesting 

10. interesting 

9. checking my understanding 

5. can help to improve 

4. useful 

3. I want to do some practise 

1. finish homework 


Note: Numbers in front of the comment denote 
the subject’s serial number, not frequency. 


KEY TERMS 


Interlanguage: The language outputs pro- 
duced by second-language learners in their learn- 
ing process, which are different from those the 
native speakers would produce when they convey 
the same meaning. 


Process Approach to Grammar Teaching: 
Students learn the target language through using 
the language, for example, in some task-based 
learning activities. 


Product Approach to Grammar Teach- 
ing: Students are exposed to a clear and explicit 
framework about the language, e.g. the form or 
the structure of the target language. 


WebCT: A web-based course authoring, de- 
livery and management tool. 
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ABSTRACT 


This chapter presents the key findings of a longitudinal study conducted with secondary school students 
over a period of five years to determine whether the use of ICT has an influence on the learning of L1 
French and L2 English, on students’ motivation and attitudes, and on the quality of their written work. 
Three research questions were framed to provide (i) a description of the process of integrating ICT; (ii) 
measurements of student attitudes and motivation in relation to school, to learning and to ICT; and (iii) 
a systematic assessment of written work in French and English. Students in four learning environments 
were observed. Results include indications that, for students in the experimental environment, ICT use 
is closely linked to the pedagogical context; motivation and attitudes remain more stable than in the 
control groups; the texts they produce are significantly longer and contain more complex clauses. 


INTRODUCTION is now called ICT. This has been accompanied 

by increasing and diverse ICT-oriented research, 
In recent years, L2 teaching and learning have and projects demonstrating its practical applica- 
seen an increasing interest in the use of comput- tions in teaching (Chapelle, 2001; Warschauer & 
ers, the Internet, multimedia resources, and what Healey, 1998). In areas such as electronic literacy 
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(Shetzer & Warschauer, 2000; Warschauer, 2003), 
mutiliteracies (The New London Group, 1996), 
synchronic or asynchronic communication, 
computer-mediated communication (Warschauer, 
1996a), ornetworked classroom interaction, many 
avenues have been explored and many questions 
raised in relation to L2 acquisition. 

At a local level, since the early 1990s, educa- 
tors in Quebec have been exploring the merits 
of integrating ICT into instruction in secondary 
schools and attempting to gain a clear picture 
of its impact on learning. The necessary first 
step was to determine the best way to integrate 
ICT, yet it is not easy to define the impact of this 
integration in secondary schools or to ascertain 
whether successes in L1 French and L2 English 
learning should be attributed to ICT use, or to 
other factors such as the individual teacher, the 
pedagogical approach, student attitudes and 
motivation, or school and parental expectations. 
Furthermore, the Quebec Department of Educa- 
tion wanted to know whether students learned 
better with or without ICT at school, particularly 
since its introduction would require the investment 
of significant sums of money into the education 
system. There were two schools of thought: the 
more skeptical questioned the real benefit of ICT 
inschools and demanded rigorous evaluation and 
statistical proof of its effectiveness; while oth- 
ers, more convinced but fewer in number, were 
ready to implement the plan without the support 
of experimental proof. 

It was in this context that a three-part research 
project was mounted in secondary schools be- 
tween 1998 and 2003. The same cohorts of stu- 
dents, native French speakers, were observed in 
relation to ICT use, and L1 French and L2 English 
learning. The three parts of the projectrelated to (i) 
a description of the process of integrating ICT, (ii) 
measurement of student attitudes and motivation 
in relation to school, to learning and to ICT, and 
(iii) systematic assessment of written work. 

The research was based on the observation 
of one group of students in each of the following 


four contexts or learning environments: (1) aclass 
using a project-based teaching approach (PBTA) 
as amain pedagogical feature where students (and 
teachers) worked within networked classes with 
laptop computers and had home Internet access. 
This learning situation was referred to as ICT 
with PBTA; (2) a class without PBTA in which 
students were taking an informatics class in a 
computer laboratory (ICT without PBTA); (3) a 
class in which students had no access to ICT and 
where they were learning through a PBTA (PBTA 
without ICT); and (4) a class using neither ICT nor 
PBTA (no PBTA or ICT). Each group contained 
between 25 and 30 students. 

It should be noted that the ICT with PBTA en- 
vironment represents “full integration of ICT” in 
the sense that teachers and students have recourse 
to ICT in every class every day over the five years 
of their secondary schooling. The ICT without 
PBTA situation represents “partial integration of 
ICT”, as access to ICT by students in this situa- 
tion is occasional and limited, with their use of 
the computer laboratory occurring in the context 
of informatics classes, at a rate of 90 minutes per 
nine-day cycle, and over only one year of their 
secondary schooling. So, although two of the 
learning situations involved ICT use, those situ- 
ations were radically different with respect to the 
extent of ICT integration. The former provided 
what could be termed “complete” integration, the 
latter occasional or “partial” integration. 

It was necessary to move from a situation 
where perceptions were based on enthusiasm for 
and confidence in ICT with no empirical proof 
to one in which the impact of ICT on learning 
could be measured and which provided longi- 
tudinal observation in real classroom contexts. 
This three-part project makes such a transition 
possible. Its originality stems from the aspects it 
examines, the number of participants, the dura- 
tion of the project, the instructional contexts it 
studies, and its parallel consideration of both the 
qualitative and quantitative dimensions. It would 
provide answers to a need expressed locally in 
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Quebec at the end of the 1990s, but it would also 
go some way to answering needs which have 
been articulated in the broader context of applied 
linguistics by researchers such as Ortega (1997), 
Chapelle (2001), and Tucker (2000, 2003), and 
referred to by Grabe (2004) who emphasizes 
the need to examine the effectiveness of ICT in 
foreign language learning and questions whether 
ICT produces a significant difference in learning 
outcomes. Barr (2004a) expresses a similar need 
to examine the effectiveness of ICT. Our project, 
then, fits broadly into this area of research in ap- 
plied linguistics. 

The following sections summarize each of the 
parts of the research in turn. It should be noted 
that the research conducted in relation to Part 1 
is qualitative, whereas that of Parts 2 and 3 is 
quantitative in nature. This approach provides 
observation of the pedagogical context from 
which the data providing the foundation of the 
quantitative parts of the study are derived. 


PART 1: DESCRIPTION OF THE 
INTEGRATION OF ICT 


The research calls for measurement of attitudes 
and motivation as well as assessment of written 
products. This requires a quantitative approach 
and, when it comes to the evaluation of writing, 
one focusing principally on product evaluation. 
However, in order to satisfactorily interpret the 
results obtained in these two parts of the project, it 
seemed essential to devote some time to the learn- 
ing process itself through detailed observation of 
the pedagogical context in which the subjects of 
the study were working. It is in the qualitative 
section of the study that these observations are 
gathered. It is conducted in parallel with the other 
two parts, but only in two of the four learning 
situations of the quantitative section (ICT with 
PBTA, and ICT without PBTA). 

The object of the qualitative study was to see 
exactly how the integration of ICT occurred in 
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the day-to-day operation of two secondary classes 
in two different programs. The specific question 
addressed by the research was “How do the learn- 
ing and teaching of French and English occur in 
a class incorporating ICT and using PBTA, and 
how do the learning and teaching of French and 
English occur in a class incorporating ICT not 
using PBTA?” For the class in the first program, 
the students, equipped with a networked laptop 
computer with home Internet access, had constant 
access to ICT for the duration of their second- 
ary schooling (Grades 7 to 11). This learning 
condition (ICT with PBTA) was the one that the 
quantitative parts of our project (Parts 2 and 3) 
had established as the experimental group. For the 
class in the second program, the computer class 
was seen as one of their routine school subjects. 
It was taught by an informatics specialist in a 
computer laboratory, with three 90-minute periods 
per nine-day cycle, and over a full school year. 
Access to ICT was limited in that the laboratory 
had to be booked each time before any activity 
requiring the use of ICT could be undertaken. 
This class (ICT without PBTA) was of one of the 
control groups in the quantitative parts of our 
project (Parts 2 and 3). Findings from research 
conducted during the first two years of this part 
of the project have already been the subject of 
publications, with the basic characteristics of 
these two classes being studied in the context 
of sociocultural theory and Engestrém’s model 
of an activity system (Parks, Huot, Hamers, & 
Lemonnier 2001; 2003; 2005). 

The data collected reveal that in the case of the 
learning environment represented by the PBTA 
with ICT group, where there is “complete” integra- 
tion of ICT, this is tied closely to the pedagogical 
activities both in the French and English classes 
as well as in the other subjects. In addition to 
having acquired impressive skills in relation to 
ICT use, the students in this environment learned 
to manage their learning and perform rather im- 
pressive tasks for their age as well as being quite 
at home with the technology. They also learned 
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to work as a team and to collaborate with each 
other, which demonstrates that the model adopted 
by the students was very consistent with the one 
that had been established by the team of teachers. 
A number of factors such as the nature of the ac- 
tivities, the relationship between the students and 
their teacher, the physical layout of the class, and 
the school rules, help create a stimulating class 
environment and encourage students to see the 
school as a pleasant and attractive place to be. 


PART 2: ATTITUDES AND 
MOTIVATION IN RELATION TO 
SCHOOL, TO THE LEARNING OF 
FRENCH AND ENGLISH, AND TO 
THE USE OF ICT 


The role of motivation and attitudes in language 
learning is well-known in the social psychology 
of language. There are numerous Canadian and 
Quebecois works on the subject including those 
of Gardner and his fellow researchers. Particular 
reference should be made to the models proposed 
by Gardner (1985) and Dornyei (1998). A fuller 
description of these approaches can be found in 
Hamers and Blanc (2000). Without going into 
their models in detail, it should be noted that 
one point they have in common is that attitudes 
and motivation act as intervening variables that 
contribute to improved results in L2 learning. 
In other words, the more positive the attitudes 
and motivation, the more likely the learner is to 
achieve good results in learning. It follows that 
any pedagogical approach designed to increase 
motivation and create more positive attitudes to 
language and to learning can be assumed to have 
a beneficial effect on language learning. 
Several recent studies show that the use of 
ICT in school increases the learner’s motivation 
to learn (see, for example, Isabelle, 2002). Some 
studies seem to indicate that using a computer 
has a positive influence on motivation and on at- 


titudes towards language (Davis & Lyman-Hager, 
1997; Warschauer, 1996b). Barr (2004b) points 
out that, generally speaking, university students 
do not have negative attitudes towards the use of 
information and communication technologies in 
language learning, but that the use of technol- 
ogy frequently depends on factors beyond their 
control, and this may make them hesitant. Des- 
marais (1998) has also shown that the use of L2 
computer-based activities has a positive influence 
on attitudes towards computer use. Computer use 
hasa positive effect on self-confidence in computer 
usage and on computer-related attitudes in general 
(Levine & Donitsa-Schmidt, 1998). There was, 
then, general agreement that using a computer for 
learning has a beneficial effect on attitudes and 
motivation in L1 or L2 learning. 

In a review of the literature on the use of ICT 
in L2 learning, Salaberry (2001) points out that 
the success of ICT use often depends on the par- 
ticular activities involved. He stresses that use of 
the Internet in L2 learning has a beneficial effect 
as long as the technological activity is supported 
by pedagogical activities, and in particular by the 
placing of cognitive demands on the learner. 

In this context, then, there was every reason 
to believe that implementing a program in which 
students (and teachers) worked within networked 
classes with laptop computers (Giguére & Gré- 
goire, 1995) would have a positive effect on the 
attitudes and motivation of students at secondary 
school. This program, which relies not only onthe 
use of a laptop computer in learning but also ona 
project-based teaching approach, corresponds to 
the ICT with PBTA situation mentioned earlier. It 
was compared with the other three learning situa- 
tions, also mentioned earlier, that is, ICT without 
PBTA; PBTA without ICT; and neither PBTA nor 
ICT. The object of this part of the study, then, 
was to determine whether the learning context 
represented by the ICT with PBTA experimental 
group had any influence on student attitudes and 
motivation in relation to learning, to school, and 
to the use of ICT. 
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Students in the experimental and control 
groups were studied over a period of five years. 
The specific question addressed by the research 
was “To what extent does use of ICT in second- 
ary classes increase learning motivation and 
encourage positive attitudes to L1 French and 
L2 English?” The following hypotheses were 
formulated: 


1. Students inthe ICT with PBTA environment 
would be more motivated to learn L1 French 
and L2 English, to use ICT generally, to use 
ICT in learning L1 French and L2 English, 
and to go to school; and 

2. They wouldalsohave more positive attitudes 
towards learning L1 French and L2 English, 
to ICT use generally, to ICT use in learn- 
ing L1 French and L2 English, and towards 
school. 


Throughoutthe research, attitudes and motiva- 
tion were measured by means of questionnaires 
administered at the beginning of the fall of each 
school year. Questions in the questionnaires 
were related to 12 topics corresponding to the 
hypotheses formulated earlier: (1) motivation to 
learn French, (2) motivation to learn English, (3) 
motivation to use ICT generally, (4) motivation to 
use ICT in learning French, (5) motivation to use 
ICT in learning English, (6) motivation to go to 
school, (7) attitudes towards learning French, (8) 
attitudes towards learning English, (9) attitudes 
towards using ICT, (10) attitudes towards learning 
French using ICT, (11) attitudes towards learning 
English using ICT, and (12) attitudes towards 
school in general. For each topic, students were 
given six statements formulated in sucha way as to 
allow them to express agreement or disagreement 
onafive-point Likert scale, ranging from “strongly 
disagree [1]” to “strongly agree [5]”. Point [3] was 
the neutral position, indicating neither agreement 
nor disagreement on the part of the respondent; the 
intermediate points were disagree [2] and agree 
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[4], with a score of less than [3] indicating a low 
motivation or a negative attitude. 

For each of the 12 topics, six statements were 
proposed; these clusters were submitted to an 
analysis of internal consistency: alpha values var- 
ied from 0.608384 to 0.828937. Only one question 
had to be eliminated from the final analysis. Thus, 
each of the 12 topics was measured by a scale of 
six or five statements. The means given are the 
means for the statements includedin a given scale, 
that is, the mean for the scale motivation to learn 
French, is the mean of the answers to the six state- 
ments included in this scale. Results were further 
subjected to analyses of variance, which allowed 
comparison of the four environments in Years 1, 2, 
3 and 5 of secondary school. In addition, multiple 
comparison LSD (Least Significant Differences) 
tests were used, in order to assess the significance 
between the means when a significant main effect 
was obtained in an ANOVA. In the following 
pages we refer only to those results which were 
significant. For the LSD tests, we give only the 
level of significance, or p value. 

Such scales inevitably produced subtle differ- 
ences in results, but it can be said that, overall, 
these results show that attitudes and motivation 
tend to decrease in all groups in the course of 
their secondary schooling. In the experimental 
group the decrease is much less and remains 
ahead of the other groups in this respect in the 
longer term. 

The key findings of the statistically sig- 
nificant results are summarised in the following 
paragraphs. The results derive from a series of 
analyses carried out over the five-year period. It 
would not be possible to present full tables of all 
these statistical tests in the context of the pres- 
ent article. A more detailed presentation can be 
found in Huot, Hamers, Lemonnier, and Parks 
(in preparation). 

For the reader who does not want the details of 
the analysis, the results for the motivation scales 
are summarized in Table 1, while Table 2 presents 
those relating to the attitude scales. 
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More specifically, the motivation scales show 
that the motivation to learn L1 French of students 
in the experimental group is stronger from the 
beginning of Secondary 2, and remains so across 
the entire period of theirsecondary schooling (with 
means varying from 3.85 to 3.43 from Secondary 
1 to Secondary 5), than that of students in the 
other environments (2.85 to 2.94 for environ- 
ment 2; 3.45 to 3.18 for environment 3, and 3.81 
to 2.88 for environment 4). In Secondary 1, the 
group in environment | does not have a signifi- 
cantly higher motivation than the other groups, 
but it is noticeably different from Secondary 2 on 


Table 1. Summary of main results on motivation 


(environment x Year F = 9.7298; p < .0001; LSD: 
p < .000 for the three comparisons). Moreover, 
this distinction is maintained in Secondary 3 (F 
= 2.8859; p = .0618; LSD: p < .000 and p < .000) 
but not in Secondary 5. 

The scale for motivation to learn L2 English 
shows that this motivation is similarin Secondary 
1 in environments 1 (4.08), 3 (4.24) and 4 (3.89), 
but not in environment 2 (3.62) (p < .0001). It be- 
comes stronger in the experimental group than in 
the groups inthe other environments, particularly 
in Secondary 3 and beyond (for environment 1, 
the means for Secondary 1, 2, 3 and 5 are 4.08, 


1. Motivation to learn L1 French 


2. Motivation to learn L2 English 


Experimental group (environment 1) does not have a higher motivation 
than the three control groups (environments 2, 3 and 4) in Secondary 1, 
but maintains a higher motivation throughout Secondary 2 and 3; this 
difference disappears in Secondary 5. 


The motivation to learn L2 English is similar in environment 1 to that 
of the other groups in Secondary 1; it is maintained throughout the 


3. Motivation to use ICT generally 


4. Motivation to use ICT in 
learning L1 French 


5. Motivation to use ICT in 
learning L2 English 


6. Motivation to attend school 


period of secondary schooling, while it drops in the control groups; the 
combination of ICT and PBTA seems to have an effect on the motivation 
to learn English. 


At the beginning of secondary school, the motivation to use the ICT 
generally is strong in all the groups, but more so in the experimental 
group (Environment 1). This difference is maintained throughout 
secondary school. 


The students in the experimental environment are more motivated in 

the first two years of the secondary school and their motivation remains 
stronger during all the secondary schooling. The combination of ICT and 
PBTA has a positive effect on their motivation. 


This motivation is higher in the experimental group and remains so 
throughout secondary school. The use of ICT in the classroom seems to 
have a positive effect on the motivation to use ICT in learning the L2. 


At the beginning of the secondary this motivation is very strong and 
identical for students in all four environments. It remains stronger for the 
students of the experimental group than for those who do not receive ICT 
and/or PBTA. 
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Table 2. Summary of main results on attitudes 


1. Attitudes towards learning L1 
French 


2. Attitudes towards learning L2 
English 


3. Attitudes towards the use ICT 


generally 


4. Attitudes towards the use of 
ICT in learning L1 French 


5. Attitudes towards the use of 
ICT in learning L2 English 


6. Attitudes towards school in 
general 


These attitudes vary throughout the period of secondary schooling. They 
are similar to those of the environment 4 (no ICT, no PBTA) in Secondary 
1, become more favorable in Secondary 2 and 3 and are again similar in 
Secondary 5. They are more favorable than those of the environment ICT 
with no PBTA, but similar to those of the environment PBTA without ICT. 


The attitudes towards learning L2 English in the experimental environment 
differ only from the environment without ICT and PBTA throughout 

the period of secondary schooling, and from the ICT without PBTA 
environment in Secondary 1. Here, we cannot conclude that there is an 
effect of ICT or PBTA. These attitudes are very favorable in all groups. 


These attitudes are more positive in the experimental environment from 
the beginning of secondary school and remain so throughout the period of 
secondary schooling. 


Attitudes towards learning L1 French using ICT are similar to those of 

the no ICT or PBTA group at the beginning of secondary school, but 

more positive than those of the other two groups. In Secondary 2, they 
remain positive in the experimental group but drop in the no ICT or PBTA 
environment. In the experimental group they remain more positive than 

in the other groups throughout the period of secondary schooling. The 
ICT-PBTA combination thus seems to have a positive influence on these 
attitudes. 


The experimental group’s attitudes towards learning L2 English using ICT 
are more positive than those of the other three groups at the beginning of 
secondary school and remain so until the end of secondary school. The 
ICT-PBTA combination thus seems to have a positive influence on these 
attitudes. 


The experimental group’s attitudes towards school in general are no 
different from those of the other environments in Secondary 1, but they 
remain positive in the experimental group in Secondary 2, 3 and 5, whereas 
in the groups not using PBTA they fall from Secondary 2 on. They are more 
positive than those of the no ICT or PBTA group throughout the period of 
secondary school and appear to be more positive than those of the PBTA 
without ICT group in Secondary 5. The ICT-PBTA combination thus seems 
to have a positive influence on these attitudes. 


4.14, 4.40 and 3.88 respectively; for environment 
3, 4.24, 3.81, 3.84 and 3.27; for environment 4, 
3.89, 3.65, 3.41 and 3.13). These differences are 
significant (F = 10.4662; p< .0001); LSD compar- 
ing the experimental group with the others groups 
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are all significant (p < .0001). The combination 
of ICT and PBTA seems to have a bearing on the 
motivation to learn English. 

The scale for motivation to use ICT generally 
reveals that, right from the beginning of secondary 
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school, this motivation is very strong in all groups 
(varying from 4.54 to 3.23) but stronger in the 
experimental group (from 4.54 to 4.20), and that 
this edge is maintained throughout the period of 
secondary schooling (F = 17.9352; p< .0001; LSD: 
all comparisons between the experimental group 
and the other groups are significant: p < .000). 

The scale for motivation to use ICT in learning 
L1 French shows that students in the experimental 
environment are more highly motivated than those 
in the other groups, particularly during the first 
two years of secondary school (3.77 and 3.79 for 
environment 1 compared to 2.73 and 2.39, 3.14 
and 3.11, 3.36 and 2.90 respectively; F = 11.4886; 
p = 0.0013; LSD : p < .000 for the comparisons 
between the experimental group and the three 
control groups); they retain this stronger motiva- 
tion over the rest of their secondary schooling (F 
= 5.0275; p = 0.0088). In this case, the influence 
of the ICT-PBTA combination on their motivation 
appears quite clear. 

The scale for motivation to use ICT in learning 
L2 English reveals that this motivation is higher 
in the experimental group throughout the period 
of their secondary schooling (it varies from 4.23 
to 3.83 for environment 1, compared to 3.57 to 
3.08, 3.79 to 3.65 and 3.99 to 3.66 for the other 
environments) (F = 8.9438; p < .0001). Here, 
the use of ICT in the classroom seems to have a 
positive influence on the motivation to use ICT 
in learning English. 

The scale for general motivation to attend 
school shows that, at the beginning of secondary 
school, the motivation is very strong and identical 
for students in all four environments (4.82, 4.73, 
4.74 and 4.76). It also shows that the motivation 
of students in the experimental environment 
appears stronger at the end of secondary school 
than that of students in the no ICT or PBTA group 
(4.99 compared to 4.72; F = 5.4508; p = 0.0235; 
LSD: p <.000). 

Results from the attitudes scales indicate 
that the attitudes towards learning L1 French of 
the group in the experimental environment vary 


across the different years of secondary school. 
They are similar to those of the no ICT or PBTA 
group in Secondary 1 (4.07 compared to 4.13) but 
become more positive than those of that group in 
Secondary 2 (4.10 compared to 3.34) and become 
similar again in Secondary 5. They are more posi- 
tive than those of the ICT without PBTA group in 
Secondary 1, and they are just the same as those 
of the PBTA without ICT group (interaction en- 
vironment x Year: F = 6.5105; p = .0004). In this 
area, then, PBTA would seem to have a greater 
influence on attitudes. 

The attitudes towards learning L2 English of 
the experimental group are more positive than 
those of the no ICT or PBTA group (from 4.30 
to 4.57 compared to 3.95 to 4.37). But no other 
difference was observed in relation to the other 
groups, apart from the ICT without PBTA group 
at the beginning of secondary school (F = 8.7875; 
p = .0046). This suggests that neither ICT, nor 
PBTA, nor the ICT-PBTA combination have an 
influence on these attitudes. 

The attitudes towards using ICT of the experi- 
mental group are more positive right from the 
beginning of secondary school, and these positive 
attitudes are maintained throughout the period 
of secondary schooling (4.35, 4.42, 4.43 and 3.77 
for the group in the experimental environment, 
compared to attitudes varying from 3.20 to 3.78 
for the three control groups; F = 53.3179; p < 
.0001; F = 20.8963; p < .0001 and F = 14.7055; p 
< .0001; LSD: p < .000). 

The experimental group’s attitudes towards 
learning L1 French using ICT are similar to those 
of the no ICT or PBTA group at the beginning of 
secondary school (3.88 et 3.73), but more positive 
than those of the other two groups (3.16 and 3.39) 
(F = 8.6333; p < .0001). In Secondary 2, they 
remain positive in the experimental group (3.99) 
but drop in the group in the no ICT or PBTA en- 
vironment (3.19) (interaction environment x Year 
F= 10.2888; p<.0001). Inthe experimental group 
they remain more positive than in the other groups 
(F = 3.1993; p = .0462; for the LSD comparisons 
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between environment 1 and the other environ- 
ments, p values vary from .0325 to p < .000), 
throughout the period of secondary schooling. 
The ICT-PBTA combination thus seems to have 
a positive influence on these attitudes. 

The experimental group’s attitudes towards 
learning L2 English using ICT are more positive 
than those of the other three groups at the begin- 
ning of secondary school (4.24 compared to 4.03, 
4.01 and 3.95; F = 4.0902; p = .0086), and remain 
so until the end of secondary school (F = 6.3301; 
p = .0028; LSD: p varies from .0500 to .0001 
between the experimental environment and the 
other environments). The ICT-PBTA combina- 
tion thus seems to have a positive influence on 
these attitudes. 

The experimental group’s attitudes towards 
school in general are no different from those 
of the other environments in Secondary 1 (3.92 
compared to 3.65, 3.71 and 3.99), but they remain 
positive in the experimental group (3.84, 3.74 and 
4.01 in Secondary 2, 3 and5), whereas in the groups 
not using PBTA they fall from Secondary 2 on. 
They are more positive than those of the no ICT or 
PBTA group throughout the period of secondary 
school (F = 4.7420; p = .0340) and appear to be 
more positive than those of the PBTA without 
ICT group in Secondary 5 (4.01 compared to 3.62). 
The ICT-PBTA combination thus seems to have 
a positive influence on these attitudes. 

Significant results can sometimes be attributed 
to ICT, and sometimes to ICT use in conjunction 
witha PBTA. Generally speaking, motivation and 
attitudes are positive in all groups, but they are 
more strongly maintained in the experimental 
group than in the control groups. They can be 
summarized as follows: 


1. Significant results attributable to use of 
ICT: Long term, thatis, between Secondary 
1 and Secondary 5, motivation for ICT use 
in general, and motivation for using ICT in 
learning English are stronger in students 
in the experimental environment; these at- 
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titudes and motivation remain stable in the 
experimental group throughout secondary 
school. Motivation and attitudes towards 
school, which are extremely positive at the 
beginning of secondary school, remain 
strong in the experimental group. This is 
not the case for the other groups. 

2. Significant results attributable to use of 
ICT in conjunction with a PBTA: Long 
term, that is, between Secondary 2 and Sec- 
ondary 5, attitudes and motivation towards 
learning French, attitudes and motivation 
towards learning English, and attitudes to- 
wards school in general are more positive in 
students in the experimental environment; 
medium term, that is, between Secondary 
3 and Secondary 5, the motivation to learn 
English is stronger in students in the experi- 
mental environment. 


PART 3: ASSESSMENT OF 
WRITTEN PRODUCTS IN FRENCH 
AND ENGLISH 


Over the past decade, several researchers have 
been interested in the question of the quality of 
written expression of subjects using ICT in the 
classroom or the laboratory. Some have established 
a positive link (Chun, 1994 for L2 German; Sotillo, 
2000 for L2 English ; Warschauer, 1996a), and 
others a less clear one (Kern, 1995 for L2 French), 
between ICT use and the length and syntactical 
complexity of messages. Contextual differences, 
however, make it difficult to compare their find- 
ings with our own. The contexts in which those 
studies were conducted in fact differ from that 
of the present study in several respects, particu- 
larly in regard to the length of observation of the 
subjects, the type of ICT use, and the number 
and variety of variables considered in evaluating 
written products. 

Chun (1994), for example, observed adult sub- 
jects in two groups over a two-semester period, 
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repeating the exercise on several occasions for 
each group; while the observations of Kern (1995), 
Warschauer (1996a), and Sotillo (2000) were based 
on a single semester. In regard to the type of ICT 
use, Chun (1994), Kern (1995), and Warschauer 
(1996a) compared the performances of subjects 
using electronic communication software (either 
Computer Assisted Class Discussion (CACD), 
or Daedalus InterChange), with performances 
in face to face communication; whereas Sotillo 
compared the content of asynchronous messages 
with that of live electronic messages via computer- 
mediated communication (CMC). The number 
and variety of linguistic variables forming the 
basis of the evaluation of written products are 
also different. They range from 2 to 12, and deal 
with length, syntactical and lexical complexity, 
and morphology. 

Briefly, the studies referred to above are 
characterised by: (1) ICT use which often takes 
the form of electronic communication and whose 
integration is often only partial, (2) subjects being 
observed over arelatively short period (one ortwo 
semesters), (3) analysis of written expression based 
on only asmall set of criteria, (4) arelatively small 
number of control groups, (5) it has not always 
been possible to provide statistical analyses. 

Moreover, inareview of literature very closely 
associated with our project, Ortega (1997) rightly 
pointed out that in order to understand the link 
between use of a given electronic medium and the 
linguistic quality of the interlanguage, the valid- 
ity of future research would be enhanced by (1) 
having more than one control group, (2) analysing 
the interlanguage over more than one year and 
increasing the number of syntactical and lexical 
measures applied, (3) basing comparisons of 
learner output on tasks of a more traditional nature 
and making those comparisons over time. 

The part of our research relating to the as- 
sessment of written products in L1 French and 
L2 English meets the requirements expressed 
by Ortega (1997). Specifically, and unlike the 
research cited above, it does so in relation to the 


number of control groups (3 as opposed to 1), its 
duration (4 years as opposed to one or two semes- 
ters), the number and variety of linguistic variables 
involved in the analysis of written products (59 as 
opposed to between 2 and 12), and by the writ- 
ing tasks given to the students (particularly the 
production of formal written texts as opposed to 
texts where the keyboard is used to communicate 
what are essentially “oral” messages). 

Finally, to our knowledge, none of the studies 
conducted prior to 1998 was based on asecondary 
class where each student worked on a networked 
laptop computer in every one of their school sub- 
jects, using a project-based teaching approach. 
This class, called ICT with PBTA, was observed 
and compared with groups in our other research 
environments. 

The objective of this part of the study was 
to find out whether ICT use in conjunction with 
a project-based teaching approach, that is, the 
environment of our ICT with PBTA group, had 
any effect on the quality of written expression 
either in L1 French or L2 English. The specific 
question addressed by the research was: «Does 
classroom use of ICT have an effect on the quality 
of written products in first-language (L1) French 
and second-language (L2) English in secondary 
students?» 

In order to answer this question, the ICT 
with PBTA experimental group was compared 
to three other control groups: the ICT without 
PBTA group; the PBTA without ICT group; and 
the group using neither ICT nor PBTA. A set 
of writing pieces in L2 English and L1 French, 
produced by these students in four of the five 
years over which the study was conducted, was 
subjected to close analysis based on 59 units 
of analysis or variables falling into four broad 
categories: general (six variables), syntactic (19 
variables), lexico-grammatical (21 variables) and 
textual (13 variables). All analyses were subjected 
to interrater agreement and to comparisons using 
statistical tests (Repeated-measure ANOVA and 
LSD). In every case, the reliability coefficient 
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exceeded 0.87. For a more detailed discussion of 
the linguistic variables studied, refer to Lemon- 
nier and Gagnon (forthcoming). 

The results show that the use of ICT, with or 
without PBTA, has an influence on the quality 
of written products for variables in two of the 
categories examined: general and syntactic. 
With regard to comparisons for the other vari- 
ables, those providing a measurement of lexical, 
orthographic and grammatical performances 
(the lexico-grammatical category) and textual 
performances (textual category), students in the 
ICT with PBTA experimental group were, in 
statistical terms, fully comparable with those of 
the other groups. 

ANOVA tests were conducted on the full set 
of data, along with multiple comparisons using 
the LSD method. The following tables present 
the basic findings of analyses which revealed 
significant differences. The results of these mul- 
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tiple comparisons are significant when the value 
of pis < .05, and are tending towards it when the 
value of pis < .09. 

With regards to L1 French, the following 
significant LSD test results highlight the effects 
of ICT: 


. long term (after four years) between the 
group in environment 1 (ICT with PBTA) 
and the group in environment 3 (PBTA 
without ICT) in relation to the number of 
words, number of sentences and number 
of clauses, indicating that ICT use has an 
influence on text length (see Table 3); 

° medium term (after three years) between the 
group in environment 1 (ICT with PBTA) 
and the group in environment 4 (no ICT 
or PBTA) in relation to the percentage of 
subordinate clauses and the percentage of 
adverbial clauses, indicating that ICT use in 


Table 3. Significant differences for L1 French after four years 


ICT use 
. Words Sentences Clauses 

Comparisons 

between neon (Standard error) eo (indent: | Nieau (Standard error) 
number number | error) number 

Environment 1 431.62 (33.00) 24.59 (2.28) 49.20 (3.84) 

Environment 3 307.09 (30.17) 18.09 (2.09) 40.00 (3.51) 

P value .0103 .0459 .0897 


Table 4. Significant differences for L1 French after three years 


ICT use with a PBTA 
Subordinate clauses Adverbial clauses 
Comparisons between |yjean 
(Standard error) Mean percentage (Standard error) 
percentage 
Environment 1 81.22 (3.78) 93.57 (7.43) 
Environment 4 68.45 (3.76) 61.32 (7.42) 
P value .0218 .0052 
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conjunction with PBTA has an influence on 
the syntactical complexity of clauses (see 
Table 4); 

° short term (after two years), the use of ICT 
in conjunction with or independently of a 
PBTA, does not appear to influence student 
performance. 


With respect to L2 English, the results show 
significant differences in the following areas: 


° long term (after four years) between the 
group in environment 1 (ICT with PBTA) 
and the group in environment 3 (no ICT or 
PBTA) in relation to the number of words, 
indicating that ICT useinfluences text length 
(see Table 5); 

° medium term (after three years) between 
the group in environment 1 (ICT with 
PBTA) and the group in environment 4 (no 
ICT or PBTA) in relation to the percentage 


of coordinate subordinate clauses and the 
percentage of coordinate adverbial clauses, 
indicating that ICT use in conjunction with 
PBTA influences the syntactic complexity 
of clauses (see Table 6); 

short term (after two years) between the 
group in environment 1 (ICT with PBTA) 
and the group in environment 4 (no ICT or 
PBTA) in relation to the number of words, 
number of sentences, number of clauses (see 
Table 7a), and inrelation to the percentage of 
coordinate subordinate clauses, percentage 
of relative clauses embedded in subordinate 
clauses, and percentage of coordinate adver- 
bial clauses (see Table 7b), indicating that 
ICT use in conjunction with PBTA influences 
both text length and clause complexity. 


The above results prompt three further ob- 
servations. Firstly, the link between ICT use and 
writing quality is aless important factor than might 


Table 5. Significant differences for L2 English after four years 


ICT use 


Words 


Comparisons between 
Mean number 


(Standard error) 


Environment 1 369.50 (30.04) 
Environment 3 278.43 (29.87) 
P value .0423 


Table 6. Significant differences for L2 English after three years 


ICT use with a PBTA 

oondinate subordinate Coordinate adverbial clauses 
Comparisons between ene 

Mean (Standard Mean 

(Standard error) 

percentage | error) percentage 
Environment 1 8.18 (1.99 15.19 (3.91) 
Environment 4 1.53 (1.99) 2.25 (3.90) 
P value .0270 0281 
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Table 7a. Significant differences for L2 English after two years 


Use of ICT with a PBTA 
Words Sentences Clauses 
Comparisons between [yjean (Standard Mean (Standard Mean (Standard 
number error) number error) number error) 
Environment 1 190.19 (12.26 13.60 (1.16) 25.58 (1.91) 
Environment 4 121.35 (12.30) 10.60 (1.16) 17.61 (1.91) 
P value .0001 .0494 .0024 


Table 7b. Significant differences for L2 English after two years 


Use of ICT with a PBTA 
Coordinate subordinate Relative clauses embedded : : 
F ; : Coordinate adverbial clauses 
Comparisons clauses in subordinate clauses 
between Mean (Stand. Mean (Stand. Mean 
(Stand. error) 
percentage error) percentage error) percentage 
Environment 1 9.08 (1.79) 17.59 (4.92) 9.16 (2.97) 
Environment 4 0.74 (1.61) 2.35 (4.47) -0.28 (2.67) 
P value .0002 .0276 0229 


be thought. In fact, of the four categories (general, 
syntactic, lexico-grammatical and textual) used 
in determining writing quality in this work, only 
the first two, text length (general category), and 
clause complexity (syntactic category) yielded 
significant results. More specifically, for French 
LI, the analysis shows significant results for three 
variables out of six in the general category after 
four years; for the syntactic category there is a 
significant effect for only two of the 19 variables 
after three years. For English L2 there is a sig- 
nificant effect for three variables out of six after 
two years and for one variable out of six after 
four years in the general category; there is also 
a significant effect for three variables out of 19 
in the syntactic category after two years. The 
use of ICT does not seem to help improve the 
students’s performance with regards to the cor- 
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rect use of language at the morphological, lexical 
and orthographic levels (the lexico-grammatical 
category); neither does it seem to help the students 
to integrate new information with either previous 
or following information (textual category). 

Secondly, the connection between the use of 
ICT, in conjunction with or independently of a 
PBTA, and writing quality seems more clear-cut 
in L2 than in L1, at least in the short term. In fact, 
after two years of ICT use in conjunction with 
a PBTA, only the texts written in L2 English are 
longer and show an increase in the number of 
more complex clauses. 

Thirdly, in the long term (after four years), 
ICT use has a clear bearing only on text length, 
in terms of the number of words for L2 English, 
and the number of words, sentences and clauses 
for L1 French. 
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DISCUSSION AND CONCLUSION 


By comparing four learning environments rep- 
resenting full, partial or zero integration of ICT, 
this five-year longitudinal study endeavoured to 
provide answers to three research questions relat- 
ing to (i) a description of the process of integrat- 
ing ICT; (ii) student attitudes and motivation in 
relation to school, to the learning of French and 
English, and to the use of ICT; and (iii) the quality 
of students’ written work in French and English. 
Although at the time of embarking on this study 
there was an abundance of works on the use of 
ICT in L2 teaching, our research questions were 
prompted primarily by a social concern within 
Quebec education circles where questions had 
been asked since the early 1990s on the value 
of integrating ICT into secondary schools and 
on the role of ICT in learning. To some extent 
they were asking whether ICT use was going to 
make any difference in students’ acquisition of 
French and English. A social preoccupation of 
this nature sits squarely among research concerns 
expressed subsequently by Ortega (1997), Cha- 
pelle (2001), Tucker (2000, 2003), Grabe (2004) 
and Barr (2004a). 

The results obtained do provide answers for 
the secondary education sector. It is, however, not 
possible to establish more than a partial match 
with results obtained by other researchers work- 
ing in the area of ICT because of differences in 
parameters such as (i) the age of the target group 
(in our case, secondary students who were 12 
years old at the beginning of the project and 15 
at the end; the other studies involved groups of 
adults); (ii) the duration of the study (five years in 
our case, and less than one year in the other cases); 
(iii) the nature and degree of integration of ICT 
(for our experimental group, complete integration 
coupled with a project-based teaching approach 
where teachers and students are networked and 
use ICT in every class each day of their second- 
ary schooling; the other studies involved partial 
integration). Moreover, the results presented above 


for Parts 2 and 3 of our study give statistically 
significant differences obtained using Repeated- 
measure ANOVA tests and multiple comparison 
LSD tests. 

The findings of our study are summarised 
in the answers it provides to the three research 
questions. Thus, the description of the process 
of integrating ICT showed that for the group us- 
ing fully integrated ICT, the technologies were 
closely tied to the learning activities, which does 
not occur in the case of partial integration. This 
part of our research also revealed that pedagogi- 
cal concepts and the introduction of innovative 
teaching practices into the program were part of 
a broader social context. Discussion of innovative 
teaching was set in a sociocultural framework 
with particular reference to Engestrém’s model 
of an activity system (Engestrém, 1991). This 
part of the research also showed how ICT was 
used differently in the two learning contexts or 
environments and how different elements such as 
program objectives and institutional factors have 
a bearing on the integration. In such a context, 
a broader view is taken of language acquisition, 
and ICT is seen as a resource within a pedagogy 
of multiliteracies. 

The section on “attitudes and motivation in 
relation to school, to the learning of French and 
English, and to the use of ICT” revealed that even 
though there is a decline in the motivation and 
attitudes of all students between Years 1 and 5 
of secondary school, and this occurs regardless 
of the learning environment, ICT use has a more 
steadying effect on motivation and keeps attitudes 
positive, particularly attitudes towards ICT use 
and towards school in general. It should be noted 
here that studies on both attitudes and motivation 
have shown that, with adults, partial integration of 
ICT tends to increase motivation and create more 
positive attitudes (Davis & Lyman-Lager, 1997; 
Desmarais, 1998; Isabelle, 2002; Warschauer, 
1996b), whereas our study shows that, with 
adolescents, full integration of ICT over a long 
period contributes to a reduction in the decline in 
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motivation that occurs in any event in the course 
of their secondary schooling. 

The section on “assessment of written products 
in French and English” with its analysis based on 
a set of 59 criteria, revealed that use of ICT, in 
conjunction with or independently of a PBTA, in- 
fluences text length and clauses complexity. These 
results corroborate those of earlier studies (for 
example, Chun, 1994; Warschauer, 1996a; Sotillo, 
2000) even though these studies were conducted 
in quite different contexts. The results also show 
that ICT use, in conjunction with or independently 
of PBTA, does not influence performance at the 
lexical, grammatical, orthographic and textual 
levels. Compared to the studies referred to earlier, 
the originality of this research lies in the fact that 
the written products were subjected to multi-level 
analysis, and the results of these analyses were 
compared using statistical tests. 

We now know that the use of ICT in learning 
French and English in secondary school makes 
an important contribution at the pedagogical, 
motivational, attitudinal and linguistic levels. The 
results have in fact shown that for students in the 
experimental group, ICT use is closely linked to 
learning activities and to the pedagogical context, 
that their motivation and attitudes remain more 
stable than those of students in the control groups, 
and that their texts are significantly longer and 
contain clauses that are more complex. 

Finally, conducting a longitudinal project of 
this kind has allowed the researchers to observe 
first-hand the emergence of a new learning com- 
munity which, thanks to ICT and the Internet, 
extends well beyond the bounds of the classroom 
and the L2 class. It has also made it possible to 
observe the advent of anew literacy where students 
have integrated ICT for the purpose of completing 
learning projects directed towards real interlocu- 
tors and/or real readers. And consequently, it has 
made it possible to observe the gradual changes 
taking place in literacy practices and to see the 
emergence of the new types of literacy (computer 
literacy, information literacy, multimedia literacy, 
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computer-mediated communication literacy) 
referred to by Warschauer (2003). 
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KEY TERMS 


Attitudes: Definedas acertain predisposition 
to react in a given way. 


Environment 1: ICT with PBTA: refers to 
a class using a project-based teaching approach 
(PBTA) as a main pedagogical feature, where 
students (and teachers) worked within networked 


100 


ICT and Language Learning at Secondary School 


classrooms with laptop computers and had home 
Internet access. 


Environment 2: ICT without PBTA: refers 
to a class without PBTA, in which students 
were taking an informatics class in a computer 
laboratory. 


Environment 3: PBTA without ICT: refers to 
aclass in which students had no access to ICT and 
where they were learning through a PBTA. 


Environment 4: Neither ICT neither PBTA: 
refers to a class using neither ICT nor PBTA. 


ICT: Information and Communication Tech- 
nologies. 


LSD: LSD (least significant differences) test 
refers to a multiple comparison test used in order 
to assess the significance between the means 
when a significant main effect was obtained in 
an ANOVA. 


Motivation: Defined as the amount of effort 
one is willing to put in a given task. 


PBTA: Project-Based Teaching Approach. 


Variable: In Question 3 the term “variables” is 
used in a particular sense, namely as measurable 
units of analysis or elements that were identified 
in the student written products. 59 variables 
were identified falling into four broad categories: 
general (six variables), syntactic (19 variables), 
lexico-grammatical (21 variables) and textual 
(13 variables). 
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Chapter VII 
Computer-Enhanced 
Grammar Teaching 


David Barr 
University of Ulster, Northern Ireland 


ABSTRACT 


This chapter reports on the results of a study undertaken to gauge what difference computer technol- 
ogy makes to grammar learning. Unlike other studies that compare the student performance learning 
grammar with the aid of technology to performance and without the technology, this work focuses on 
the impact technology has on student attitudes towards learning grammar through the computer. The 
chapter outlines how traditional grammar classes have been adapted for delivery in a multimedia situ- 
ation and assesses the impact, both in terms of students’ perceptions about learning of grammar and in 
their actual performance that the computer has had on the process. The chapter also draws on the les- 
sons learned in this project to help to maximise the potential of using technology in this type of teaching 


and learning context in the future. 


INTRODUCTION 


Studies have shown that the transition between 
school and university can be difficult (Martinez, 
2001). There are many reasons for these diffi- 
culties, including adjustment to a new teaching 
environment. Students often require a period of 
readjustment and training to encourage them to 
become more active, constructivist learners and 
to extend the learning experience beyond the 


classroom (Fry & Ketteridge, 1999, p. 37). Within 
the area of language learning, implicit grammar 
teaching can be seen as one way to promote ac- 
tive learning and develop learner responsibility 
(Davies & Williamson, 1998). Adamson (1998) 
points out, however, that this isnot always the best 
way for students to learn grammar and Schulz’s 
(2001) examination of the importance of correc- 
tive feedback from teachers points convincingly 
towards a need to ensure that students are not 
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left entirely to their own devices in the study of 
grammar. Furthermore, Krashen (1999) points 
out that post secondary language students are not 
only used to formalised grammar teaching, but 
expect it. This suggests that despite the importance 
of students taking more responsibility for their 
learning, the study of grammar is one area where 
they need explicit guidance, especially in the early 
stages of their post secondary education. 

The use of computer programs to guide and 
support students in their learning is not a new 
concept, in particular in the area of language 
study, which has been the subject of much research 
over the last two decades (See Levy, 1997, for 
example). In particular, the potential for using 
technology for teaching and providing explicit 
guidance in more mechanical areas of language 
learning, such as vocabulary acquisition and 
grammar learning have been well documented 
(Powell, 1998; Sciarone & Meijer, 1993). Studies 
also have been conducted comparing the use of a 
computer-based approach toa traditional teacher- 
directed approach to determine whether one is 
better than the other. One of these (Nutta, 1998) 
provides some quantitative conclusions showing 
that the computer-based approachis more effective 
for grammar teaching than the teacher-directed 
approach. Many of these studies tend to point 
towards improvements in student performance 
in grammar related tasks. Nevertheless, success 
in teaching grammar needs to be examined in 
context. Despite the explosion in packages that 
teach grammar (and do so very well) over the 
past 20 years or so, Engel and Myles (1996) point 
towards the decline in the standards of grammar 
among students entering higher education: this 
means that more and more students are coming 
into university with a less developed appreciation 
of foreign language grammar and, as a result, 
considerable time needs to be spent at the early 
stages of their university career revisiting basic 
areas of grammar, which can sometimes have 
a demotivating effect on students. For some, 
the revision of basic grammar is seen as a step 
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backwards (even though it probably is not); for 
others, the admission that they struggle with basic 
grammar is a source of personal embarrassment. 
In both cases, this can affect their willingness to 
contribute to or even attend grammar classes. 
This suggests that the issue to be addressed in 
the area of learning grammar is not only develop- 
ing packages that teach grammar well and that 
produce quantifiable improvements in grammar 
acquisition but also that important changes are 
required in student attitudes and perceptions to 
motivate them to learn grammar. 

In keeping with the research aims of the book, 
of which this chapter forms part, (i.e., to provide 
comprehensive coverage of successful translation 
of language learning designs utilizing ICT in 
practical learning contexts), this study will discuss 
the findings of a project that saw the teaching of 
French grammar move from a traditional teach- 
ing room to being taught in multimedia language 
computer rooms, thereby changing the entire 
dynamic of the teaching and learning experience. 
The chapter will examine whether technology has 
helped to change the attitude of students towards 
learning grammar through an initiative under- 
taken among first year undergraduates of French 
at the University of Ulster, many of whom had 
very different attitudes towards learning gram- 
mar. The work undertaken seeks to address two 
main research questions: 


a. Does the use of technology make any quali- 
tative difference to student attitude towards 
grammar work? 

b. | Howdoperceptions and qualitative evidence 
compare to quantifiable student perfor- 
mance? 


The chapter will outline the stages involved 
in the project, before assessing whether engage- 
ment with a computer-based model for grammar 
learning had any impact on student learning. It 
will do this through quantitative study of the stu- 
dent cohort and also through a micro-analysis of 
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the performance of six students. It also will use 
qualitative analysis to gauge student reaction to 
the use of computers for grammar learning. The 
chapter will then examine the effects of using a 
computer-based model for teaching and learning 
grammar before drawing on a number of lessons 
learned through the project. 


PROJECT STAGES 


If students are to take maximum benefit from 
grammar classes, itisimportantto address student 
perceptions of grammar learning, and to provide 
students with an opportunity to appreciate their 
weaknesses in grammar in an unobtrusive and 
more comfortable manner. The need to address 
student perceptions of grammar learning at the 
University of Ulster were borne out in the results 
of a questionnaire, administered at the begin- 
ning of semester 1 of the 2005/06 academic year 
to first year undergraduate students of French, 
which asked students about their perceptions and 
expectations of learning grammar. Thirty-five 
percent of respondents (where N=20), felt that 


learning grammar was enjoyable (see Figure 1). 
The remainder said that learning grammar rated 
somewhere between of average interest to rather 
uninteresting. These figures suggest that students 
are not enthused about grammar classes, yet, 
as outlined above, grammar study remains an 
essential component of language learning that 
many students fail to grasp. 

In this context, languages staff undertook an 
initiative aimed at consolidating and developing 
the grammar skills by attempting to change stu- 
dent perception about grammar classes. It also 
was hoped to encourage students to engage in a 
more active way with their grammar learning, to 
help address the Engel and Myles’ concern about 
declining standards in grammar learning. The 
initiative was divided into three stages: 


1. Thecompletion of computerised diagnostics 
tests to identify strengths and weaknesses 
in the area of grammar. 

2. To change the environment in which gram- 
mar classes take place by moving teaching 
from seminar/lecture rooms to multimedia 
learning laboratories. 


Figure 1. Students attitude towards grammar administered at the beginning of the semester 


Please rate how enjoyable you feel the study of 
grammar is in language study: % (N=20) 
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3. Encouraging students to use CALL exercises 
online outside class in an effort to strengthen 
key grammar concepts. 

Phase 1 


All students within a first year French gram- 
mar class completed a computerised diagnostic 
multiple-choice test at the start of semester. The 
purpose of the test was to assess the level of 
ability in main grammatical areas of French. The 
tests were completed using the Virtual Learning 
Environment, WebCT. The tests were completed 
electronically to facilitate greater re-usability as 
results were automatically collated on the system 
and the data displayed in a format that could be 
easily interpreted by tutors. The format provided 
the question, the possible answers and the per- 
centage of students who chose each answer, with 
the correct answer highlighted. This provided the 
tutors with immediate feedback on student per- 
formance and, at a glance, they could see which 
questions were most problematic for the cohort 
of students. This provided a valuable insight for 
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tutors as it allowed the tutors to focus in class on 
areas on grammar that the test had shown were 
particularly difficult for the students. The same 
test was taken again at the end of the semester 
(i.e., 11 weeks later) to gauge whether students 
had made progress in any of the areas of difficulty 
that had been highlighted in the initial test. 


Phase 2 


Grammar teaching has traditionally taken place in 
seminar or lecturerooms. Inan effort to encourage 
greater student participation and involvement with 
this aspect of language study, it was decided to 
deliver grammar classes ina multimedia learning 
room to allow students to have greater ownership 
of their learning: ownership is one of the traits of 
active learning, as discussed by Reagan (Reagan, 
1999). Furthermore, technology allows learners 
the freedom to work at their own pace and level 
(Hoven, 1999). In the multimedia lab, classes were 
split into two parts: the first stage would take the 
form of a grammar lecture where grammatical 
theory was discussed, often using PowerPoint 
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to deliver main ideas and concepts: these notes 
were subsequently posted within a course area on 
WebCT, so that students could access information 
outside class. The theory was then supported by 
grammar exercises on the topics covered, many 
of which had been created online, using the Hot 
Potatoes authoring tool. These exercises were 
uploaded to a dedicated area on the Web, known 
as HotPotatoes.net. 


Phase 3 


In addition to completing some online exercises 
in class to assess their understanding of gram- 
matical aspects under discussion, students were 
encouraged to continue working through these 
exercises in their own time and revisit exercises 
that they found most difficult. Students also com- 
pleted a series of activities in Clef, a networked 
CALL program, available to students in the mul- 
timedia lab. Often, students would be directed 
to this material as an adjunct to the exercises on 
HotPotatoes.net and, in particular, students who 
had obtained low scores in their initial diagnos- 
tic test, were encouraged to complete remedial 
exercises on Clef. 


METHODOLOGY 


In measuring the effectiveness of this computer- 
based model, we need to be mindful of Thornbury, 
Elder, Crowe, Bennett, and Belton (1996) who 
believe the value of the technology is not neces- 
sarily measured on its technological excellence 
or astounding quality but rather on how well the 
technology is integrated into the teaching and 
learning experience. In other words, the role given 
to the technology in supporting and facilitating 
teaching and learning are important in assessing 
the overall success of a project like the one under 
discussion here. A broadly similar argument is 
offered by Felix (2005), In order to assess the 


level of integration, a number of data collection 
methods were used: 


a. Questionnaires. Students were given ques- 
tionnaires at the beginning and end of the 
semester. The first questionnaire (N = 20) 
asked students to comment on their experi- 
ences of learning grammar to that point and 
the second questionnaires (N = 21) asked 
students to provide qualitative feedback 
on the grammar classes: what they liked, 
disliked and their perception of the use of 
the technology. 

b. The performance of each student in both 
diagnostics tests (28 in total) was analysed. 
More importantly, the tests were used to 
identify areas of improvement or lack of 
progress in key grammatical areas studied 
during the semester. 

c. A micro-analysis of six students was 
conducted, mapping student use of Hot- 
Potatoes.net against student performance 
in the diagnostics test to examine the cor- 
relation between using the above computer 
technology and achievements in grammar 
learning. 


STUDENT PROGRESS QUANTIFIED 


The performance of the all students (N=28) has 
been analysed in Figure 3. The results show dif- 
ference in performance on each question between 
the first and second tests across the entire cohort 
of students. This graph demonstrates that the 
student performance on some questions is better 
than on others and, insome cases, the performance 
is worse on the second test (questions four, seven, 
and eight). Clearly, other factors affect the per- 
formance of students; these include the level of 
study of grammar topics that students undertook 
independently of class, including revision from 
grammar books and theuse of self-study packages 
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Figure 3. Student cohort performance on each question in first and second tests 
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such as Clef. Furthermore, it might be expected 
that students would improve in the second test as 
the grammar areas that had been highlighted as 
deficient in the first grammar test were covered 
by the tutor in grammar classes throughout the 
semester. 


Micro-Analysis 


The results in Figure 3 show the enhanced per- 
formance in the second diagnostics test was not 
always evident across the entire cohort of stu- 
dents. The inconclusiveness of these results also 
is furthered evidenced by a micro-analysis of the 
performance of six students. These students were 
chosen based on their performance over both di- 
agnostics tests and represent the top, middle and 
lower achievers in the class, reflecting the larger 
sample size of 28. 


Student One 
This student scored 14 out of 20 in her initial 
diagnostics test on WebCT. This was the second 


highest score of the cohort. The second test saw a 
slight improvement (16 out of 20). It seems obvi- 
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ous from these scores that this student had a good 
understanding of key grammatical concepts. A 
more detailed study of this student’s performance 
showed that although she improved on one area 
of grammar in the second test, this area was not 
covered by the range of online material provided 
to the student. At the same time, however, the 
student in question undertook a large number of 
activities online (36). She concentrated on one 
area of grammar (the use of position of Direct and 
Indirect Object Pronouns) and repeated most of 
the exercises in this area at least twice. Interest- 
ingly, despite the practice, the student answered 
one of the two questions in this area incorrectly 
in the second diagnostics test. Her performance 
in the diagnostics test in this grammatical area 
and the number of attempts she made at the online 
exercises in that area show that this is clearly a 
difficult area for the student. 


Student Two 


Performance of this student in the diagnostics test 
was similar to that of Student One. He improved 
by three marks (13/20 in test 1 and 16/20 in test 
2). It may be unlikely that this can be attributed 
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to practice in the online exercises, created using 
Hot Potatoes, as this student completed a small 
number of exercises online (a total of 12) and made 
no attempt to revisit any exercise to consolidate 
his understanding of the grammatical issues. 


Student Three 


This student scored 10 out of 20 in the first diag- 
nostics test and there was a marginal improvement 
(11 out of 20) in the second test. This student 
carried out 20 exercises online in HotPotatoes. 
net, five of which were in one area of grammar 
(the Perfect tense). Interestingly, this was one of 
the areas where the student had improved between 
the first and second diagnostics test. Given the 
small improvement in the student score, it would 
be unwise to speculate that this improvement was 
due to the use of online exercises. 


Student Four 


This student made no improvement in terms of 
her result in the diagnostics test. In both, she 
scored nine out of 20. Somewhat paradoxically, 
this student had completed 26 grammar exer- 
cises online. Although there was no quantitative 
improvement or worsening of her result, three 
grammar areas that had been answered correctly 
in the first test was incorrectly answered in the 
second test. The student had, however, studied all 
these areas online. However, a further study of 
the student’s results revealed that she had made 
no attempt to self-diagnose. In other words, there 
is no evidence that the student tried repeating 
exercises to improve on previous results. Had the 
student used the online material for the purpose of 
remedial practice ratherthan for one-off exercises, 
the results may have been different. 


Student Five 


This student scored six out of 20 in the first 
diagnostics test and there was a substantial im- 


provement in the second test (13 out of 20). This 
student carried out a total of 12 exercises online. 
This was the second lowest number of exercises 
completed on the online system, yet the improve- 
ment between the first and second diagnostics test 
was the most significant of the group. Nonetheless, 
like Student Four, this candidate had not made 
any attempt to revisit any of the exercise already 
completed for further practice. 


Student Six 


This student scored six out of 20 in her first diag- 
nostics test and 12 out of 20 in her second. She 
completed 23 online grammar exercises. Although 
her score showed a noticeable improvement, it 
became clear, upon analysis, that the student had 
failed to make progress in three areas of grammar 
that had been practised quite extensively using 
the exercises on HotPotatoes.net. 

The results from the micro-analysis of six 
students demonstrate further that the link be- 
tween the use of computer-based grammar sup- 
port and enhanced student performance in the 
online tests is tenuous. They highlight an issue 
raised by Chapelle and Hegelheimer (2000) that 
“linguistic input, such as that received through 
CALL materials, needs to become intake in order 
to be acquired by the learner” (p. 42). This means 
if CALL materials, such as those created online 
using Hotpotatoes.net, are to be effective, the 
learner has to engage meaningfully with them. 
Success is therefore not measured on the number 
of exercises completed but rather the thoroughness 
spent over each activity. Given that few students 
in this project used the online materials for con- 
tinual practice, re-testing themselves at stages 
in the semester to ensure knowledge retention; 
it is not surprising that our quantitative results 
are inconclusive: effective learning requires the 
learner to play his part too. 
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STUDENT ATTITUDES TO THE USE 
OF ICT IN LEARNING GRAMMAR 


The previous section has shown that the progress 
made by students in their learning of grammar was 
not quantifiably improved by the use of computer 
technology. Did that mean, however, that the atti- 
tudes of students to the use of the computer-based 
model were negative? At the end of the semester, 
students were asked to comment on the grammar 
classes and the general feeling was that the classes 
were enjoyable. Some of the comments made by 
the students are listed below: 


“T think Hot Potatoes is a really good way of 
practicing grammar points.” 


“T liked it, was clear and helpful and easy to use 
and interesting.” 


“_, like the way you have to keep working before 
you are given a clue or answer.” 


“T think that Hot Potatoes was an excellent way 
to learn main grammar points.” 


Furthermore, 70 percent of respondents (where 
N=13), commented on the positive impact that 
technology brought to the class. Although this 
cohort is small, the overwhelmingly positive 
feedback about the use of technology is signifi- 
cant. It suggests that the technology impacts upon 
student attitudes. Furthermore, it implies that the 
technology can be used for intrinsically motivat- 
ing students which, according to Newstead and 
Hoskins (1999), is central to the learning experi- 
ence of higher education. This means encouraging 
students to enjoy their learning experience rather 
than solely to seek academic reward through high 
coursework marks. 

What factors may explain the positive reaction 
of students? Gillespie and McKee (1999) estab- 
lished a number of factors that influence student 
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attitudes. These can be divided into psychological, 
infrastructural and educational factors. 


PSYCHOLOGICAL FACTORS 


Increasingly, computer technology has become 
such an integral and everyday aspect of student 
lives, with many students coming to university 
already having used computers extensively in 
primary and secondary schools (Cuban, 2001). 
At the same time, however, in their analysis of 
student reaction to the use of ICT in language 
learning, Gillespie and McKee, (1999) found that 
students feel insecure when using computers for 
language learning and seek reassuring guidance 
from teachers. In other words, although students 
may be very computer literate, they do not neces- 
sarily know how to use computers for language 
learning, especially at the early stages of their 
study at university. In the project discussed in 
this chapter, the teacher’s role in this project was 
central: ranging from explaining the grammar 
theory to monitoring student progress as they 
worked through the online exercises, either by 
walking around the classroom and answering 
questions or by viewing the scores that students 
obtained in their exercises. Students in this project 
seemed to find the role of the teacher essential. 
Their observations cited “human” aspects of class 
(explanations given by teachers, atmosphere in 
class...) as the important/influencing factors in 
class (cited by 77 percent of respondents). This 
view is supported by Tharp and Gallimore’s model 
of Vygotsky’s Zone of Proximal Development 
(1988). In their model, Tharp and Gallimore (1988) 
state that there are anumber of stages to effective 
learning: stage one is called “assistance by more 
capable others” (an expert teacher, student peer 
or even a computer). The second stage requires 
“assistance by the self.” In other words, in addition 
to support from the teacher, the student needs to 
engage with what he is learning. 
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One way of achieving this is to retain student 
interest in what he is doing. Warschauer (1996), 
for example, believes that an amalgam of differ- 
ent computer-based approaches is necessary to 
achieve effectiveness. This means that instead 
of always using one piece of software or hard- 
ware, students’ interest is best retained if vari- 
ous media can be used. In this project, students 
used online exercises on HotPotatoes.net, a local 
based dedicated software, such as Clef and ac- 
cessed grammar notes on WebCT. Each had their 
own interface and students therefore needed to 
learn how each one operated, thereby giving the 
students fresh stimulus throughout the course 
of activities. There is, of course, a danger of in- 
formation overload and if the range of activities 
becomes too complicated and varied, there is 
greater potential for students to feel insecure and 
lost, with the result that the learners “switch off” 
and, far from feeling stimulated, do not engage 
with the resources and material: a view echoed 
by Gillespie and McKee (1999). 

These observations suggest that, in the stu- 
dents’ opinion, the technology did not dominate 
the classroom experience. The realisation that 
the computer technology is not all-encompassing 
(but rather has a supporting role) and is a means 
to an end rather than an end in itself is key if 
successful integration of CALL into the teach- 
ing and learning process is to be achieved (See 
McCarthy, 1999). 

In addition, this project sought to ensure that 
the use of computer technology in their learning 
did not represent too drastic a culture shock for 
the students. Ninety-five percent of respondents 
in the first questionnaire noted that they have 
traditionally learned grammar by completing 
written exercises in class. In this cohort, students 
used the technology for the same purpose: they 
completed exercises to drill them on key gram- 
mar concepts. Barr discovered that students are 
not as radical as we might think when it comes 
to embracing technology (2004) and this would 


suggest that students do not necessarily enjoy us- 
ing technology for tasks with which they are not 
familiar. Since they are familiar with the concept 
of learning grammar by completing exercises, 
using the Web for this task is not that radical a 
change for them and therefore does not take them 
too far outside their comfort zone. 

The reaction of students reveals another im- 
portant aspect of using technology to enhance 
the student learning experience: the computer 
refocuses attention in class. Stepp-Greaney (2002), 
quoting Hartman, Neuwirth, Kiesler, Sproull, 
Cochran, Palmquist, and Zabrow, states that “the 
use of technology redistributes ... classmate at- 
tentions” (p. 165). This allows the students to hide 
their performance (and embarrassment over poor 
performance) from the rest of the class, which, in 
turn, may encourage students to loose their inhi- 
bitions about answering questions through fear 
of giving the wrong answer — an issue that can 
often affect the dynamic of classes. The “virtual” 
environment, therefore, encourages enhanced 
class participation by students. 


INFRASTRUCTURAL FACTORS 


Another factor that influences student attitudes to 
the use of ICT in language learning, according to 
Gillespie and McKee, relates to the infrastructure 
within which students work. By focusing the 
activities in class around the use of computer 
technology, there was a real danger of increasing 
the pressure on the hardware and software, leading 
to such problems like slow network speeds and 
difficulty accessing the Hotpotatoes.net server 
could have caused frustration among students, 
with a real danger that this could become a major 
source of discouragement for students, even caus- 
ing resistance (see Esch & Zahner, 2000; Kung & 
Chuo, 2002). In addition, the classes in this study 
took place in multimedia language learning labs. 
Students were encouraged to work on the online 


109 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


materials and use the locally-based dedicated 
grammar software available in the labs in their 
own time outside class. The teaching labs were 
open from 9:00am to 5:00pm every day (Monday 
to Friday) and, whereas students could use the 
labs in their own time during the day, the labs 
were heavily booked for teaching purposes. This 
meant that students had restricted access to the 
labs. Nevertheless, students also had access to a 
self-study resource area called the Multimedia 
Resource Unit. This facility operated the same 
opening hours as the multimedia labs but was 
not used for teaching purposes, meaning that it 
was much more accessible for students. It also 
contained anumber of PCs that provided the same 
range of dedicated language learning software 
as the teaching labs. Furthermore, the exercises 
uploaded to Hotpotatoes.net and the provision 
of notes on WebCT, meant that some resources 
were available on the Web and could be accessed 
from any PC, so if the multimedia labs were oc- 
cupied and the PCs in the Multimedia Resource 
Unit were all being used, students could use any 
other PC lab on campus or could even access the 
exercises from their own computer, either in halls 
of residence or from home. 

According to the results of the second question- 
naire, only two students commented on hardware 
or software difficulties with either the online 
exercises or, More generally, with the computer 
environment (access to computers/labs...). We 
might assume that technological difficulties did 
not have an impact on the attitudes of students 
towards the computer-based model. Itis likely that 
if students could not access the grammar software 
outside class time, in the Multimedia Resource 
Unit or online, for example, student feedback 
would have been less positive. This highlights an 
important issue for colleagues seeking to integrate 
computer technology into their teaching. If stu- 
dents are expected to use hardware and software 
outside teaching time, they need adequate access 
to the resources. 
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EDUCATIONAL FACTORS 


Incompatibility with the modern languages cur- 
riculum has been blamed for students reacting 
negatively to the use of computer technology in 
their learning (Gillespie 1995). In other words, if 
students feel that the use of computer technology 
does not help them in their learning, they are 
likely to be unwilling to embrace its use. The 
quantitative evidence presented above shows 
that there is little sign that the use of technology 
in this project produced “actual” benefits for the 
students, as their academic performance was not 
significantly enhanced by using the computer- 
based model. That said, however, the use of tech- 
nology can have affective benefits. According to 
Stepp Greenay (2002), if students enjoy using the 
technology and feel there are benefits to using it, 
this influences student perceptions and attitudes 
towards learning and ultimately gives themamore 
positive outlook on their learning. Consequently, 
perceptions that students have about using the 
technology for learning grammar can be just as 
important as evidence of improvements in results. 
Intheir initial questionnaire, 85 percent of students 
rated the study of grammar as very important and 
the remaining 15 percent said they felt that the 
study of grammar was important. These figures 
seem to suggest that the students understood the 
importance of learning grammar and, given that 
the purpose of using the computer-based model 
in this project was to help students to learn gram- 
mar more effectively, we might infer that students 
could see that technology was being used as a 
means to help them learn what they all perceived 
as fundamental area of language learning. 

This is further supported by feedback from 
the second questionnaire, which showed that 
students wanted to have more exercises on the 
online system. This suggests that they see clearly 
the advantages of completing exercises online. 
We might assume that one of main advantages of 
completing online exercises is the instant feedback 
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they can provide—a view that is shared by Schulz 
(2001). In the first questionnaire, 95 percent of 
respondents remarked on the need for good feed- 
backin grammar testing. The online exercises that 
students completed provided feedback, hints and 
tips for particular grammar points. As a result, 
it became clear to students that completing the 
exercises online provided them with feedback 
that may have otherwise been missing in other 
forms of grammar drilling. That does not mean 
that feedback was adequate for all students. In 
fact, in the small number of cases where students 
used the online system for continued practice of 
particular grammar points, this did not guarantee 
improvement in that area in the final diagnostics 
test, which suggests that more explicit feedback 
and perhaps tailored learning paths may have 
been useful. 

We can see the value of student perceptions 
in Conole’s taxonomy of effective learning. Her 
triangular representation of learning activity 
(Figure 4) establishes that effective learning is 
only possible if based around pedagogy, tasks and 
context. Without any of the three, the process is 
incomplete. By examining the computer-based 


model in this study, we see that the technology 
provides the backdrop for the elements—the set- 
ting of the computer lab represents the context, 
the use of online exercises constitute the second 
element—the tasks and a range of pedagogical 
approaches are used (teacher-centered theoreti- 
cal explanations and student-centered activities). 
However, these three elements require something 
to bring them together to forma coherent structure. 
That is where the learner plays his part. Without 
the willingness of the learner to engage with the 
tasks, work in the context provided and engage 
with the pedagogy, the triangle is incomplete 
and effective learning is not possible. Clearly, if 
students enjoy what they are doing and feel it is 
bringing benefit to them (suchas instant feedback), 
they may be more willing to engage more actively 
in their learning activity. 


CONCLUSIONS 


The results of this paper show a number of impor- 
tant findings. Inresponse to the research questions 
posed earlier, we can conclude the following: 


Figure 4. Conole’s Taxonomy of effective learning (Copyright 2007, Grdinne Conole. Used with per- 


mission.) 


Context 


Pedagogy 


Tasks 
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1. Does theuse of technology make any qualita- 
tive difference to student attitudes towards 
grammar work? The students generally 
reacted positively to the use of a computer- 
based model in grammar teaching and that 
seemed to encourage the students to engage 
with their grammar learning and enjoy 
grammar classes, so we can conclude that 
qualitatively the technology made a differ- 
ence asit changed students’ attitudes towards 
learning grammar. The study also showed 
that there were a range of psychological, 
infrastructural and educational factors that 
influenced student reaction to the use of ICT 
in their learning of grammar. Whereas, the 
scale of this study is quite small, it further 
supports the studies of Barr (2004) and 
Gillespie and McKee (1999) on student at- 
titudes. 

2. How do perceptions and qualitative 
evidence compare to quantifiable student 
performance? There is little quantifiable 
evidence to prove that the use of technol- 
ogy improved students’ ability in grammar, 
at least in terms of their performance in 
grammar tests. Given the short time scale 
for the project (one semester of 12 weeks), 
it is most likely that a longer study would 
be needed to answer the question with any 
conviction. 


These findings show that the technology has a 
valuable role to play in the teaching and learning 
of grammar, especially in terms of influencing 
the attitudes of students. Although we cannot 
say whether the model outlined here is a success 
in terms of academic performance, the use of 
the model has had a direct influence on student 
perceptions about learning grammar and if stu- 
dents enjoy using computer technology and the 
conditions are right for doing so, the learning 
experience can be made more enjoyable. This is 
not without worth in an academic world that is 
increasingly focusing on student retention. 
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KEY TERMS 


CALL Integration: The factors that influence 
how ICT is integrated into language teaching. 


Computer-Based Learning Approaches: 
Examples of how to embed computer technology 
in learning and teaching. 


Grammar Learning: How computer technol- 
ogy can enhance/affect the process of learning 
grammar. 
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Online Learning: The use of Web-based 
technologies for language learning. 


Pedagogical Development: Lessons that can 
be learned in the pedagogical planning of language 
classes using ICT. 


Student Attitudes: The attitudes of students 
towards use ICT in language learning and what 
factors may change these. 
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Section II 
Multimedia and 
Speech Technology in 
Language Learning 


This section contains chapters on the use of multimedia and speech technology in language learning. 
The languages being covered ranged from learning Mandarin Chinese as a foreign language, learning 
Thai as a foreign language, ESL, learning German, Japanese and Italian in the foreign language con- 
texts. The focuses of the chapters ranged from pedagogical implementation of a multi-modal language 
learning approach, to the use of automated speech recognition technology in language learning. Studies 
involving the use of keystroke logging, animation, and listening comprehension software are described 
in this section. 
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Chapter VIII 
Research-Based Listening Tasks 
for Video Comprehension 


Luba V. Iskold 
Muhlenberg College, USA 


ABSTRACT 


This study examines the effects of listening tasks performed by second-semester learners of Russian. Two 
video viewing conditions are investigated: traditional, “exposure only” vs. an experimental, “viewing 
guide” condition. In the control group, learners are watching video episodes from beginning to end; after 
that they answer comprehension questions. In the experimental group, students are using online Video 
Guides designed for the present investigation, which include research-based listening tasks performed by 
the learners during video viewing. The research examines which of the two treatments produces greater 
comprehension and retention of the videotext as measured by (1) Immediate Recall Protocols (IRPs) 
written in English and (2) recall, recognition, and application tasks performed in Russian. In addition 
to objective tests, the researcher investigates participants’ opinions regarding the effectiveness of video 
viewing under each of these conditions as measured by an Exit Survey. 


INTRODUCTION 
Background 


In the last three decades, researchers and practi- 
tioners in the field have begun exploring broader 
contexts of L2 learning (Iskold, 2002), includ- 
ing tasks and activities which aid in preparing 


students who can understand and be understood 
in L2 and are sensitive to the culture(s) where 
L2 is spoken. The move toward communicative 
instruction revived the concern for teaching the 
receptive skills of listening in L2 (Iskold, 2003). 
Lending supportto listening skill development are 
studies showing that adults spend 40 to 50 percent 
of their time listening (Rivers, 1975). In our age 
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of heavy media saturation the percentages for 
listening became even higher (Omaggio Hadley, 
1993). Therefore, listening becomes an increas- 
ingly vital skill in L2 learning which explains the 
professions’ interest in authentic video materials. 
However, video-based language teaching lacks a 
significant data base (Bacon, 1992; Herron, York, 
Corrie, & Cole, 2006; Thompson & Rubin, 1996) 
and few research data are available concerning 
which tasks and activities make “video viewing 
experience more profitable for students” (Herron, 
1994, p.196). 

How do students develop listening skills by 
using video materials? Do they learn best by mere 
“exposure” to “comprehensible input” advocated 
by Krashen (1985)? In contrast, cognitive mod- 
els advocate L2 learning in which students are 
consciously involved (Harrington, 2002); a more 
recent, sociocultural approach, places L2 acquisi- 
tion in a context of social practices (Savingnon & 
Sysoyev, 2002; Warschauer, 1997). While there 
is a recent improvement from passive, non-in- 
terrupted watching of long videotexts to brief, 
electronically delivered user- controlled video 
segments, the focus on pre- and post- listening 
activities still prevails. But what are learners doing 
while the video clip is playing? Should they be 
performing low-production tasks? Which tasks 
lead to higher levels of video comprehension? 
These questions, among others, have not yet been 
answered on the basis of empirical evidence. Lack 
of research regarding the listening tasks which 
best facilitate L2 comprehension (Herron et 
al., 2006; Iskold 2003), and the current focus on 
pre- and post-viewing activities recommended by 
authors (for example, Lubensky, Ervin, McLellan, 
& Jarvis, 2005; VanPatten, Marks, & Teschner, 
2004) of video-driven commercial packages, 
leave instructors with no guidelines for designing 
listening tasks which may help students to stay 
focused while they are watching a video. 


PURPOSE OF THE STUDY 


The present study investigates two conditions of 
video viewing: “exposure-only” (students watcha 
video episode in its entirety without any interrup- 
tions) and using online Video Guides specifically 
designed for the present experiment (participants 
perform low-production listening tasks while they 
watch a video episode). The purpose of the study 
is to determine whether or not the differences in 
video viewing conditions result in significantly 
different levels of comprehension of a videotext 
by second- semester learners of Russian. 


Research Questions 
The research addresses the following questions: 


1. Which of the two video viewing conditions 
(“exposure-only” or using a Video Guide) 
appears to produce the greatest comprehen- 
sion of a videotext as measured by Immedi- 
ate Recall Protocols (IRPs) written in LI? 

2. Which of the two conditions appears to 
produce greater achievement on immediate 
recall, recognition, and application tasks 
conducted in L2? It is assumed in the study 
that (1) no participant has previously seen 
the video episodes chosen for the study; (2) 
ability to write a recall protocol is a valid 
measure of students’ video comprehension, 
and (3) no participant has serious hearing 
impairment or visual problems. 


Hypotheses 

The following null hypotheses are tested: 

Hypothesis 1: There is no significant difference 
in the effects of “exposure-only” to the 


videotext condition as compared to “video 
guide” condition, based on comprehension 


117 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Research-Based Listening Tasks for Video Comprehension 


scores of second-semester college students 
of Russian as measured by IRPs written 
in L1. 

Hypothesis 2: There is no significant effect at- 
tributable to “video guide” condition on 
students’ performance on recall, recogni- 
tion, and application tasks, as measured 
by immediate quizzes conducted in L2. 


REVIEW OF THE LITERATURE 


Constructing Tasks for Listening 
Comprehension 


The general purpose of listening is to comprehend 
a message. Richards (1983) suggested manipula- 
tion of variables as a means to develop listening 
micro-skills: 


in teaching listening we can manipulate two 
variables, both of which serve to develop the 
ability in particular skill areas. We can either 
manipulate the input, that is the language which 
the learner hears, controlling for selected features 
such as grammatical complexity, topic, and rate 
of delivery, or we can manipulate the tasks we 
set for the learner. Manipulation of either (or 
both) is directed toward developing particular 
micro-skills. 


INPUT = MICRO-SKILLS <= TASKS 
(p.232) 


Rost (1990) argued that the teaching of listen- 
ing should concern a sequence of actions carried 
out during the listening process. Lund (1990) 
emphasized the instructor’s function to “assist 
learners in some way to comprehend the message 
better” (p. 107). He also asserted that the question 
regarding the purpose of L 2 listening should be 
narrowed down to “what is the listener listening 
for?” (p. 106). 
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Theorists have proposed various approaches 
to the design of listening tasks. For example, 
Rivers (1975) claimed that each task should have 
an objective which relates to either skill-using or 
skill-getting. Drawing upon Rivers’ assertion, 
Lund (1990) suggested that in the case of skill- 
using, the objectives should be stated as listeners’ 
functions. In the case of skill-getting, the tasks 
could be based on Richards’ (1983) taxonomy. 
Blandell and Stokes (1981) maintained that tasks 
vary as to whether they require global compre- 
hension (understanding of the overall meaning) 
or partial comprehension (understanding of 
specific items). Richards (1983) asserted that 
tasks may require a mechanical, meaningful, 
or communicative response. He explained that 
a task requiring a mechanical response may ask 
the learner to distinguish between two words or 
sounds and does not require any comprehen- 
sion. A task requiring a meaningful response 
may ask the learner to comprehend the input but 
does not require any creative ability. In contrast, 
a task requiring a communicative response asks 
the listener to create a suitable response on the 
basis of what he/she understood from the input 
and thus requires interpretation, adaptation, and 
addition of new information. 

Glisan (1988) and Dunkel (1991) proposed 
models for teaching L2 listening which integrate 
cognitive skills and guide the listener through se- 
quential linguistic processing. While Glisan (1988) 
admitted that L1 listeners are doing skimming 
for gist and scanning for details simultaneously, 
she suggested that teachers should provide prac- 
tice in developing each L2 skill separately (pp. 
13-15). Joiner (1990) recommended using listen- 
ing/viewing guides which students complete while 
watching a video. Her tasks were intended not to 
test but to aid comprehension; the reading and 
writing load was kept to a minimum. Omaggio 
Hadley (1993) emphasized that listening tasks 
performed during video viewing “help students 
focus on relevant features of discourse as they are 
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being heard rather than requiring them to retrieve 
a set of facts from memory” (p. 191). 


Assessment of Listening 
Comprehension 


In L1 research, the primary method of assessing 
comprehension in either reading or listening 
modality is the use of recall protocols (Lund, 
1991). Usually, students report in writing the 
content of the text they have just processed. The 
resulting immediate recall protocols (IRPs) can 
be examined for both quantitative and qualitative 
aspects of comprehension by comparing them 
with the content analysis of the original text. 
Bernhardt & James (1987) used IRPs to assess 
L2 listening. Students wrote L1 IRPs after listen- 
ing to a L2 text. The researchers concluded that 
when writing in L1, students were able to present 
the fullest possible report. To avoid disparities 
between comprehension and production abili- 
ties, they elicited L1 answers, thereby avoiding 
the mixture of skills. While recognizing the 
advantages of IRPs, Johnston (1983) cautioned 
against using them as the only means to assess 
comprehension. 


THE DESIGN OF THE STUDY 


Pilot Study (Wasn’t There Only 
One?) 


Within a one-year period prior to the present 
investigation, this researcher conducted a pilot 
study of the effectiveness of video viewing in a 
video-driven comprehension-based foreign lan- 
guage curriculum (for details see Iskold, 2004). 
The purpose of the pilot study was to examine 
(1) student behaviors during video viewing, (2) 
perception of and attitudes toward video ma- 
terials, (3) reactions to specific types of video 


guides, and (4) ability to write IRPs. Based on 
the findings from the studies she concluded that: 
(1) multiple choice item format worked best for 
video guides; (2) during video viewing students 
were able to process approximately 20 items in 
the video guides without being distressed, and 
(3) students needed 15-20 minutes to complete 
an IRP. The results from classroom observations 
and student answers to interview questions were 
used for constructing listening tasks and the 
Video Guides for the present research. Student 
pilot IRPs aided in the design of the recall pro- 
tocol scoring sheets for this experiment. What 
follows is the description of setting, participants, 
materials and procedures employed in the present 
investigation. 


Setting 


The participants in this study were drawn from 
an undergraduate, four-year college with a total 
population of 2,000 students. As a liberal arts 
institution, the college maintains a L2 require- 
ment. Every student is required to enrol in one of 
the six languages currently offered by the college: 
French, German, Hebrew, Italian, Russian, Span- 
ish, and Latin. Among other programs, the college 
offers an interdisciplinary major/minor in Russian 
Studies. Spanish dominates language instruction 
accounting for 73 percent of all L2 enrolments. 
Elementary Language I & II courses are first and 
second- semester, Intermediate Language I & I 
are third- and fourth-semester respectively of a 
L2 sequence offered by the college. Students’ 
placement is dependent upon experience or a 
placement test. Students represent predominately 
white (91.5 percent) middle or upper-middle class 
backgrounds; the student body is mainly from the 
Middle Atlantic region (80 percent from Pennsyl- 
vania, New Jersey and New York); 70 percent of 
students come from public schools and 30 percent 
from private/parochial schools. 
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Participants 


Sixteen students enrolled in one section of Elemen- 
tary Russian II participated in the study throughout 
one semester (15 weeks). These students were 
expected to be motivated beginner learners of 
Russian. Prior to the experiment, they filled out 
Participant Information Survey during regular 
classroom time. The data from the Survey were 
tabulated and synthesized for subsequent analysis. 
The purpose of the Survey was to identify stu- 
dents with atypical backgrounds (e.g., native or 
heritage speakers of Russian; those who lived for 
more than three month in Russia; students with 
hearing or visual problems which could hinder 
the comprehension of a videotext). 

As per college classification, 12 participants 
were freshman and 4 were sophomores; there were 
seven men and nine women. The participants’ 
ages ranged from 18 to 20 years. The majority 
of students were taking the course to fulfill the 
college’s L2 requirement; 6 were planning to 
major or minor in Russian. All participants took 
Elementary Russian I at the college in the previous 
year; none of the students had prior exposure to 
the target language in high school. All partici- 
pants were native speakers of English. None of 
the students was excluded from the data analysis 
because of an atypical background. 


General Classroom Procedures 


At the college, all beginner L2 classes meet four 
times a week in periods of 50 minutes. The Rus- 
sian language curriculum incorporates “Nachalo” 
(«Hayaso»), a video-based instructional package; 
through the study of thematically organized mate- 
rials, students develop listening comprehension, 
speaking, reading, writing, and cultural knowl- 
edge about Russia. Usually, the syllabi follow 
a standard sequence of instruction. Day One: 
students perform pre-listening activities, after 
which they watch a new video in class. At home 
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they study textbook and workbook materials. Day 
Two: learners discuss the episode in class and do 
exercises. Day Three: students review class notes, 
role-play, practice vocabulary, and grammar. Day 
Four: learners take oral and/or written quizzes, 
and then move on to a subsequent episode. A 
sample Elementary Russian II syllabus may be 
obtained from this researcher. [So do they have 
Nachalo anda separate unrelated textbook? What 
did they have?] 


Variables and Treatments 


Anintact class of 16 students enrolled in Elementa- 
ry Russian II taught by one instructor participated 
in the study. For this empirical investigation, the 
class was divided into two groups. The data from 
the Participant Information Survey were used to 
establish equivalency in group composition. First, 
participants were ranked by prior achievement 
in Elementary Russian I and then randomly as- 
signed to Group | (G1, n = 8) and Group 2 (G2, 
n= 8). It was observed that the groups exhibited 
homogeneity with regard to characteristics self- 
reported in the Participant Information Survey, 
including gender, age, and GPA. 

On the first day of class, prior to any treatments, 
all participants took a baseline test on listening 
comprehension. A two-sample t-test of group 
scores indicated that the differences between 
the group means G1 (n=8) and G2 (n=8) were not 
significant, t (14) = 1.52, p > .05. The researcher, 
therefore, judged the two groups to be comparable 
prior to the study. Because the groups were in the 
same class, they followed the same syllabus, thus 
received the same instruction, completed the same 
assignments, took the same quizzes on the same 
dates and in the same setting. Throughout the ex- 
periment, the participants watched four «Hayasio»» 
video episodes (episodes 4, 5, 6a, 6b) on CD-ROM 
at the Language Learning Center under two dif- 
ferent conditions: (1) students in a control group 
(CT-control treatment) received “exposure-only” 
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Table 1. Allocation of groups by video episode 


Episode 4 Episode 5 Episode 6a Episode 6b 
Group I CTG1 ETG1 CTG1 ETG1 
Group II ETG2 CTG2 ETG2 CTG2 
to the videotext in the commercially available Materials 
format; (2) those in an experimental group (ET- 
experimental treatment) viewed the same videos Videotexts 


in conjunction with the interactive online video 
guides designed for the present investigation. One 
group served as control (CTG1) and the other as 
experimental (ETG2) for video episodes 4 and 
6a; then the groups switched for episodes 5 and 
6b (CTG2 and ETG1). The allocation of groups 
to control and experimental treatments by video 
episode appears in Table 1. 

As shown in Table 1, all participants were 
exposed to both treatments (CT and ET). If this 
measure were nottaken, a particularly interesting 
or funny episode plot might solicit high scores 
simply because it maintained student interest. 
Because the two groups were randomly assigned 
to treatments, the findings of the study are not 
confounded by the episode and can be attributed 
to differences in treatments. 

The controlled variables in the study were 
Groups (control and experimental) and Treat- 
ments, conditions for video viewing. The depen- 
dent variables in the study were (1) comprehen- 
sion scores oneach videotext as measured by four 
L1 IRPs; (2) scores in listening comprehension 
achievement, as measured by four sets of immedi- 
ate and delayed L 2 quizzes, and (3) participants’ 
opinions regarding the effectiveness of experimen- 
tal treatments, as measured by the Exit Survey. 
The experiment employed 12 objective tests and 
an Exit survey. 


The videotexts employed in the study were from 
Nachalo («Hayao»), a video-driven commercial 
package for beginner students of Russian (for the 
list of episodes used in the study see Appendix 
B). Connected by a storyline, the 2.5 to 3.5-min- 
ute video episodes are offering a way to see and 
hear the story in a variety of authentic settings. 
Based on the classification suggested by Geddes 
and White (1978), this videotext falls into the 
category of a “simulated authentic discourse.” In 
addition to the textbook, the instructional pack- 
age contains a workbook, a video guide, and a 
CD-ROM. The paper-and-pencil video guide 
in the commercially available package provides 
pre-and post-viewing exercises. Neither the video 
guide nor the CD-ROM incorporates listening 
tasks to be performed by learners during video 
viewing. 


Online Video Guides Designed for This 
Experiment 


Four interactive online Video Guides designed 
by this researcher were used by participants in 
experimental groups. The Video Guides were 
developed with Dream Weaver MX and optimized 
for play via Internet Explorer. The Video Guides 
were not intended to assess how much students 
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understood from each videotext. Instead, they 
were used to facilitate video comprehension 
by providing students with a focus for viewing/ 
listening (Joiner, 1991; Thompson and Rubin, 
1996). After clicking on the “Instructions” but- 
ton, students received online instructions prior to 
using each of the online Video Guides. Figure 1 
represents a sample “Instructions” screen from 
a Video Guide. 

First, students were asked to read through the 
items included in the Video Guide; next, they 
were instructed to watch the video twice, focus 
on specific elements of the videotext, and check 
off the relevant items as they heard them spoken 
in the video episode. Students also learned from 
the “Instructions” screen that they were not graded 
for this activity and could print out and keep the 
Video Guides for further reference. 


Each of the Video Guides consisted of two 
parts (Screens): Main Ideas (e.g., places, charac- 
ters, events, and cultural similarities/differences) 
and Details (vocabulary, phrases, cognates, and 
idioms). In addition, each Video Guide included 
an area for note-taking (see Figure 2). 

In Figure 2, items in the first column pertain 
to characters; in the second column to events, and 
in the third column to cultural similarities/differ- 
ences. In order to reduce the cognitive load and 
to avoid learner distraction from videotext, all 
items in the Video Guides were presented in a 
true/false format; the total number of items per 
screen did not exceed 20 (see pilot studies, Iskold, 
2004). Prior to the experiment, the items in the 
Video Guides were discussed and validated by 
a panel of experts. Figure 3 represents a sample 
“Details” screen. 


Figure 1._Sample “Instructions” screen. Lesson 4: “We have Terrible Problems.” (© 2007, Luba V. 
Iskold, Muhlenberg College, 2004. Used with permission.) 


Ypok 4 - Y Hac yxacHble npo6nemb! 


MAIN IDEAS 


episode. 


time. 


©.OX@OOO 
Tlpounraiire mactpyKuno 4 


Bugeo. Click on "Instructions" b 
read the instructions carefully: 


<< Previous Lesson Next] wrong. 


<< Print This Page >> 


Instructions 


Notes: 


| Viewing Guide 


“4 Nachalo - Yiewing Guide Instructions - Microsoft 


Take alook at the screen. On the left is the video window, navigation buttons, 
and a text field for note taking. On the right is the Viewing Guide for this 


Please watch the video episode two times, first for MAIN IDEAS, second for 
DETAILS. Use "Proceed to Details" button to play the episode the second 


Look over the items in the Viewing Guide, then start the video. In the Viewing 
Guide, check off the relevant items as you hear them in the video. 


Note: not every item listed in the Viewing Guide is relevant to the video 
episode. Focus on the MAIN IDEAS during the first wewing; pay attention to 
DETAILS during the second viewing. As you click on items in the Viewing 


Guide, a green ¥ indicates the right choice, a red X means that you are 


You will not be graded on this activity. When you finish watching the video, you 
may print out the Viewing Guide for further reference. 
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Figure 2. Sample “Main Ideas” screen. Lesson 4: “We have Terrible Problems.” (© 2007, Luba V. 
Iskold, Muhlenberg College, 2004. Used with permission.) 


! 
| Ypok 4 - Y Hac yxacHbie npo6nempli MAIN IDEAS 
“Teen % * 
Viewing Guide | 
Shogun Co6ermsa Kynetypa 
Click on the | Click on events Decide whether 
characters that that are discussed similar events 
participate in in the episode: usually occur in 
the episode: | the U.S.: 
Cason Bom Hosea, 
Npodeccop @ ecTtt npoGnempt. 
pasrosapusawr na wer 
Anexcanapa Hostile kBapTmpbi- | Ects ayw, 
Hiexoneeeia ete: Ho HeT BOE. 
. | aa HeT 
1 = _ aes -__s | 
Ects 
2S: Cawa npo6nemu: 
OOwOOGCO O—0 Aeepu 

| = | Bosa HEBOSMOMHO 

\TIpountaiire HACTPYKUMEO H MOcMOoTpHtTe saKperTS 

| . : 

\Bugeo. Click on "Instructions" button and 

lread the instructions carefully: Copren Hosnil nom ~ 

| Netposmy 3TO MpexpacHo 

<< Previous Lesson | Next Lesson >> ] 
<< Print This Page >> ] Down sane ee 
Instructions j i 
_ 7 | Tatesxa 
| Notes: Duutpresua 


PROCEED TO DETAILS 


In Figure 3, items in the first column represent 
familiar vocabulary (background knowledge); 
in the second column, grammatical structures, 
and in the third column, difficult new words and 
phrases. 


Testing and Scoring Procedures 


In order to assess participants’ comprehension of 
a videotext by group prior to the experiment, on 
the first day of class the researcher administered a 
pre-treatment baseline listening comprehension 
test. All participants watched a video episode from 
an instructional package comparable to the one 
used in the formal study. Immediately following 
video viewing, students answered in English 12 


open-ended WH-questions. The participants were 
able to answer the questions correctly only based 
on information found in the videotext. Discrete- 
point items (which have only one correct answer) 
were used to assess comprehension. Each test 
item was worth 0 or 1 point (0 was given for an 
incorrect answer, and 1 was given for the cor- 
rect answer). An independent evaluator blindly 
scored the tests. 

The researcher used a multidimensional ap- 
proach to the assessment of video comprehension. 
L1 IRPs were used to assess full comprehension 
of each of the four videotexts. Students were given 
15 minutes to complete their IRPs. In addition, 
the participants took four sets of paper-and-pencil 
immediate and delayed quizzes. The quiz items 
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Figure 3. Sample “Details” screen. Lesson 4: “We have Terrible Problems.” (© 2007, Luba V. Iskold, 


Muhlenberg College, 2004. Used with permission 
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in the video: 
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similar events 
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| the U.S. 


aupexrop 


A aupexrop 


Sro yxac! 


—e————————ee 

OD" DQ QOr@—0 
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<< Previous Lesson ] Next Lesson >> j 
<< Print This Page >> ] 
Instructions j 
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Sro xowmap 
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5 A 3auem 
asepu Y neé Her 
e BaHHbI sana 
STo Asro6ycHan 


npexpacHo ocTraHosKa 


Sro KoHe4HO 
mnoxo 


crenei 


were constructed in Russian thus learners were 
required to complete the quizzes in L2. Students 
took immediate quizzes right away after they 
completed the IRPs; they were given 20 minutes 
to work on a quiz. The quizzes consisted of dis- 
crete-point items. Each item was worth 0 or 1 
point (0 was given for an incorrect answer, and 
1 was given for the correct answer). The quizzes 
reflected the content of the Video Guides used 
by students in experimental groups during video 
viewing. As shown in Appendix A, each quiz 
was composed of three sections that measure (1) 
recall, (2) recognition, and (3) application of 
the main ideas (characters, places, and events) 
and details (vocabulary, grammatical structures, 
and idioms) from a «Hauasto» episode; the items 
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also addressed cultural information presented 
in the Video Guides. A total of 24 items were 
targeted in each quiz:’ multiple choice’ for recall; 
“true/false” for recognition, and “complete the 
statement” for application tasks, respectively. 
Delayed measures of (1) recall, (2) recognition, 
and (3) application were gauged by delayed 
quizzes which students took four days after they 
watched the episodes. 

Participants’ IRPs were analyzed quantita- 
tively and qualitatively using elements suggested 
by several researchers (Bernhardt & James, 1987; 
Johnston, 1983; Rader, 1990), as well as the find- 
ings from the pilot studies conducted prior to the 
experiment (Iskold, 2004). Based on the content 
analysis of the videotexts, this researcher designed 
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IRP scoring sheets (Appendix B). The instrument 
was validated by a panel of experts. For each video 
episode, the idea units were ranked in importance 
(from four points to one point). Based on this scale, 
the researcher assessed the number of (1) most 
important ideas, (2) least importantideas, (3) total 
number of sentences, (4) propositions/idea units 
recalled from visual clues, (5) propositions/idea 
units understood from discourse, and (6) total 
points scored. For further analysis, the values 
were scaled to 100 points. 


Collection and Analysis of the Data 


The present investigation continued for 15 weeks 
and involved the second half of an elementary- 
level Russian curriculum. Students watched four 
“Nachalo” videos (episodes 4, 5, 6a, 6b). Through- 
out the study, participants in control (CT) and 
experimental groups (ET) followed the same 
syllabus; there were no differences between the 
groups either in instruction, or testing proce- 
dures other than listening tasks in the Video 
Guides performed by participants in ET during 
video viewing. To enhance the reliability of the 
study, the researcher used parallel forms of tests. 
There were four sets of immediate and delayed 
quizzes and four IRPs; a test-retest format was 
used for immediate and delayed quizzes. In this 
procedure, a test with a slightly different format 
was administered to the same individuals on two 
occasions: immediately following video viewing 
and four days later; a positive correlation between 
the scores served as a measure of reliability in 
the study. Both immediate and delayed quizzes 
targeted the same content, had the same number 
of items, and employed the same item format. 
Although equivalent in terms of complexity, the 
items on delayed quizzes were slightly reworded. 
This measure was necessary to avoid student 
learning items from the previous quiz. The internal 
validity was addressed through content-valida- 
tion of the quiz items. An independent evaluator 
blindly scored the quizzes. Student IRPs were 


blindly scored by two independent evaluators 
who were trained to use the system developed 
for this study. The inter-rater reliability between 
the scores ranged form .985 to .990. 


RESULTS AND DISCUSSION 
Results 


The five dependent variables of interest were 
student scores from (1) recall, (2) recognition, 
(3) application, (4) total quiz scores, and (5) IRP 
scores. The researcher computed mean test scores 
for control and experimental groups on each 
dependent variable. Further, a nested factorial 
analysis of variance was applied for the analysis 
of variance in participants’ mean scores. The 
controlled variable, video episode was considered 
to bea fixed factor with four levels (episodes 4, 5, 
6a, 6b). The controlled variable, treatment, was 
considered to be a fixed factor nested within a 
video episode. Statistically significant differences 
were found between CT and ET groups on L1 
IRPs. Table 2 summarizes the means and standard 
deviations of participant total IRPs scores. 

The data summarized in Table 2 reveal that 
students in experimental groups (ET) consistently 
performed better than participants in control 
groups (CT) on all four L1 IRPs. Further analy- 
sis of the data indicated that participants in ET 
recalled more idea units from discourse, fewer 
idea units from visual clues and reported fewer 
least important ideas than students in CT. These 
data strongly suggest that the Video Guides 
used by participants in ET groups were effective. 
Therefore, Hypothesis 1 was rejected. 

The nested factorial analysis of variance of 
participant mean scores on recall, recognition, 
application, and total quiz scores on immediate 
L2 quizzes revealed no statistically insignificant 
differences between control and experimental 
groups. For the factor “Group,” all the p-values 
were >0.05 [recall p=0.37; recognition p=0.59; 
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Table 2. Mean scores and standard deviations on immediate recall protocols 


Video Episode Group/Treatment Mean Standard Deviation N 
4 CTG1 83.67 18.82 7 

ETG2 88.69 20.98 8 

5 CTG2 82.74 21.84 7 

ETG1 98.62 2.88 8 

6a CTG1 78.29 20.51 7 

ETG2 96.57 4.86 7 

6b CTG2 52.75 10.35 7 

ETG1 71.98 20.32 7 


[4 and 6b, for the ETG2 and ETG1, the SD are high, 20.98 or 20.32, do these reflect the 


difficulty of the video texts?] 


application p=0.44, and total scores p=0.35]. Thus, 
there were no statistically significant differences 
in scores that may be attributed to the ET (Video 
Guide) treatment. Participant scores on immediate 
and delayed quizzes demonstrated similar char- 
acteristics; no statistically significant differences 
were found between scores on either measure. 
Therefore, Hypothesis 2 was confirmed. 

At the conclusion of the experiment, all par- 
ticipants completed an Exit Survey. The purpose 
of the survey was to explore student perceptions 


of and attitudes toward the Video Guides. All 
participants completed the survey during regular 
classroom time; they responded to 10 selected- 
response survey items by checking a point on 
a five-point Likert scale from either 1, strongly 
agree to 5, strongly disagree. Table 3 provides 
the means and standard deviations associated 
with questions from the Exit Survey relevant for 
discussion. 

As shown in Table 3, the participants self-re- 
ported a noticeably positive attitude toward the 


Table 3. Mean scores and standard deviations on the exit survey 


Question Mean Standard 
Deviation 

Using Video Guides helped me to stay focused during video viewing. 2.05 0.42 
Using Video Guides helped me to remember the video episodes better. 2.00 0.61 
In my opinion, using an interactive Video Guide may help me learn more from the 2.00 0.50 
video episodes. 

I would like to continue using a Viewing Guide while watching «Hayao» 1.82 0.52 
episodes next year. 

I liked the design of the current Video Guide. 2.17 0.80 
The Video Guide distracted me from watching the video. 3.82 0.95 
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Video Guides; they (1) stayed better focused, (2) 
learned more, (3) remembered video episodes 
better, (4) liked the design of the Video Guides, 
and (5) were interested in using Video Guides in 
the future. 


DISCUSSION 


As all participants indicated in their Exit Survey 
responses, they have never used video guides 
during video viewing in any of the previous L2 
classes. Thus, the experimental treatment was new 
intheirlearning repertoires. While no statistically 
significant differences in group performance were 
found on the baseline test administered on the 
first day of class, participants in ET performed 
better than did those in CT group the very first 
time they used a Video Guide designed for this 
study. This finding suggests that video guides 
may have an immediate positive effect on student 
comprehension of a videotext. It also was noted 
that the effectiveness of the ET slightly increased 
over time, as students became accustomed to 
completing listening tasks during video viewing. 
This finding implies that learners benefit from 
practice with video guides. 

For research purposes, the number of times 
students watched each video episode was limited 
to two. This measure was necessary to assure 
that learners in CT and ET groups spent the same 
amount time on task. Further, because students 
knew their completed Video Guides were not 
assessed by their instructor, those not interested 
may have skipped over certain listening tasks 
in the Video Guides. These factors may provide 
a plausible explanation for the absence of clearly 
observable benefits of the Video Guides as mea- 
sured by student achievement on immediate and 
delayed quizzes. 

However, participants in ET groups performed 
significantly better than did students in CT 
groups as measured by IRPs. The positive effect 
of Video Guides was evidenced by significantly 


higher scores on the most important ideas recalled 
and total recall points scored. It was observed 
that participants in CT groups relied more on 
visual clues in their attempt to understand the 
video and, perhaps, to compensate for the lack of 
comprehension of discourse. Although current 
theoretical views do not advocate understanding 
of every word or phrase in a video (VanPatten 
& Cadierno, 1993) they do suggest that focusing 
students’ attention on important features of a 
videotext increases their levels of comprehen- 
sion (Thompson & Rubin, 1996). In addition, as 
evidenced by the Exit Survey, participants were 
strikingly enthusiastic regarding the effectiveness 
of the Video Guides. These findings suggest that 
the experimental treatment was effective. 

Consequently, the study supports theoretical 
assumption of others (e.g., Joiner, 1990; Omaggio 
Hadley, 1993) that viewing guides may improve 
comprehension of a videotext. Similarly, it cor- 
roborates the findings from a chain of research by 
Herron and colleagues (1992-2006) and supports 
Herron’s (1994) conclusion that “simply providing 
video material is not enough.” 

According to Glisan (1988), when listeners 
are provided with specific listening tasks, they 
are able to scan or extract particular information 
from an aural text. She argued that native speak- 
ers utilize two strategies in everyday listening: 
skimming for the gist and scanning for details; 
non-native listeners tend to experience difficulties 
in performing both tasks simultaneously. In our 
case, the Video Guides pointed out main events, 
culture, places, and characters in a video; further, 
they focused participants’ attention on vocabulary, 
idioms, and grammar targeted in each episode. In 
this sense, the Video Guides provided a strategy 
for parallel processing of main ideas and linguistic 
features of a videotext. It appears that guiding 
students through parallel processing is beneficial 
for their comprehension of a video message. This 
finding is consistent with cognitive interpretations 
of learning (O’Malley & Chamot, 1993). 
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Finally, viewing guides appear to facilitate 
new learning by helping learners identify what 
they already know and link the new knowledge 
to the existing schema (Anderson, 1983). More 
specifically, through the examination of the items 
listed in a Video Guide, students could identify 
the names of the characters or places which they 
knew prior to watching an upcoming episode. 
Similarly, cognates in the vocabulary section of a 
Video Guide may provide a way for linking new 
information to that existing ina learner’s memory. 
In this sense, a viewing guide may function as an 
advance organizer which has been proveneffective 
by Herron and colleagues (1994-2006). 


Limitations 


The following limitations should be consider- 
ing when examining the results of the study: (1) 
this research was conducted at a small liberal 
arts institution; (2) the nature of the population 
may present questions about the role of attitude, 
interest, and motivation in L2 video viewing; 
(3) the sample size was limited to 16 students; 
broadening the sample size might enhance the 
validity of the study; (4) the findings are based 
on a particular kind of videotext, simulated 
authentic discourse, hence are not applicable to 
other types of videotexts (e.g., news broadcasts 
or interviews); (5) the number of times students 
watched each video episode was limited to two; 
more or unlimited number of videotext replays 
could produce different results; (6) the results 
may not generalize to studies employing differ- 
ent assessment instruments; (7) incentives for 
students may decrease the number of missing 
observations; (8) this researcher was involved with 
the study both as an investigator and a teacher; 
(9) a longitudinal study over several semesters 
may be better suited for the purpose. 
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CONCLUSIONS 


Whereas Doughty (1991) demonstrated that 
learners’ attention can be directed to linguistic 
features of a text while reading, the present study 
suggests that similarly listening tasks performed 
during video viewing may assist in directing 
viewers’ attention to and subsequent recall of a 
videotext. 

Although prior to this experiment the par- 
ticipants never wrote IRPs of video episodes, the 
analyses of those protocols revealed that on aver- 
age, albeit to a different extent, all students were 
able to summarize main ideas of a video episode 
in an essay format; no participant performance 
received a 0 score. This finding contradicts the 
results reported by Rader (1990) who examined 
comprehension of audio messages in French and 
found a significant number of participants who 
received a 0 score on IRPs. In the present study, 
the minimum score received by a participant on 
either of the IRPs was 10 and the maximum 68 
points, respectively. A perusal of IRPs indicates 
that participants in all groups have not reported 
ideas not found in the videotext. This finding is 
at odds with the results from Lund’s (1991) study 
of comprehension of an audio text by students of 
intermediate German. Therefore, the data indicate 
that a complex cognitive task of listening is fa- 
cilitated by the visual nature of video to an extent 
which precludes complete lack of comprehension. 
Thus, video comprehension should be examined 
as a distinct modality within the framework of 
comprehension research. Moreover, there is a 
need to examine factors that influence compre- 
hension depending on the medium of presentation, 
as well as the mode of presentation (¢.g., controlled 
lab setting vs. online learning). 


Pedagogical Implications 


Several pedagogical recommendations emerge 
from this study. Even though a video-based curric- 
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ulum tends to enhance listening comprehension, 
the teacher plays an essential role in preparing 
ancillary materials to facilitate listening. Teach- 
ers may view the ET examined in the study as a 
variation of empirically validated pedagogical aid 
for student comprehension of L2 videotext; they 
may consider incorporating video guides into 
their teaching repertoires in order to maximize 
the listening practice afforded by video. The pres- 
ent research suggests further classroom research. 
Teachers can make observations that serve as the 
basis for testable hypotheses about video input 
processing (see also Hoven, 2006). Interviews, 
surveys of student opinions and action research 
all can shed light on the process of and aids to 
comprehension of a videotext. 

Certainly, one cannot presume to recommend 
that Video Guides, IRPs, and test items developed 
by this researcher be used with all L2 video-based 
curricula. However, the findings may enable teach- 
ers to make decisions concerning what types of 
listening tasks performed during video viewing 
best serve their students. 

For the reason that instructors have limited 
time to prepare ancillary materials, the final 
recommendation concerns material developers. 
The findings of this study yield information for 
the design of comprehension aids and assessment 
instruments which might be included into com- 
mercial video-based instructional packages. 


Recommendations for Further 
Research 


Despite the growing acceptance of the importance 
of L2, many questions concerning the listening 
tasks which facilitate student comprehension of 
a videotext need empirical examination. Thus, 
replications of this study are called for in order to 
further examine the unique domain of L2 video 
comprehension. Because this study deals with 
Nachalo, which is frequently used for learning 
Russian, this research may be replicated and ex- 


panded at other institutions and with other popula- 
tions of learners; similar investigations might be 
based on video-driven curricula in Russian which 
employ videotexts other than Nachalo. Itwould be 
most interesting to examine whether the findings 
of the present study hold true for comprehension- 
based curricula for L2 other than Russian. While 
the listening tasks developed for the present study 
are research-based and appear to facilitate com- 
prehension of a videotext by focusing students’ 
attention on key points in the video input, other 
types and formats of video guides may be exam- 
ined using assessment procedures comparable to 
the ones employed by this researcher. Although 
the Video Guides were intended “not to test but 
to aid comprehension” (Joiner, 1990, p. 64), for 
research purposes it might be useful to examine 
the viewing guides completed by viewers. Such an 
examination may provide insight regarding which 
among the low-production tasks learners perform 
best. Findings from such research may contribute 
to the on-going discussion about directionality of 
input processing. 

In this study, a combination of two assessment 
measures, L1 IRPs and L2 recall, recognition, 
and application tasks (ability to confirm verbatim 
text-based input), allowed for a multi-dimen- 
sional evaluation of video comprehension. An 
investigation of best-suited multi-dimensional 
formats for follow-up tests, (including, but not 
limited to recall, recognition, and application) is 
needed. To confirm the effectiveness of IRPs as 
an assessment measure for comprehension of a 
videotext, further examination and refinement of 
the scoring system suggested by this researcher 
is necessary. Research on assessment of video 
comprehension may serve a two-fold purpose: 
(1) valid assessment tools may evolve, and (2) it 
may provide an insight regarding a possible impact 
of various assessment formats on L2 retention of 
videotexts. Finally, a long-range study of tasks 
systematically performed by learners during video 
viewing may allow for conclusions with regard 
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to benefits of student active engagement in video 
viewing for overall improvement of listening 
comprehension. 
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KEY TERMS 


“Exposure-Only” Condition: Non-inter- 
rupted viewing of a video episode. “Exposure to 
massive amounts of comprehensible input” is the 
primary method of L2 teaching in comprehen- 
sion-based approaches postulated by Krashen 
(1985). 
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Foreign Language: The terms “foreign lan- 
guage,” “second language,” “target language,” 
and “language” are used interchangeably to refer 
to languages other than English taught as an 
academic subject. 


66 


Immediate Recall Protocol (IRP): A listen- 
ing comprehension measure in which listeners 
write down, from memory, what they recall after 
hearing a text (Lund, 1991). 


Simulated Authentic Discourse: Accord- 
ing to Geddes and White (1978), two types of 
authentic discourse may be used in L2 learning: 
(1) unmodified, which occurs as a genuine act 
of communication, and (2) simulated, which is 
produced for pedagogical purposes and exhibits 
features that have a high probability of occur- 
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rence in genuine acts of communication (p. 137). 
“Nachalo” episodes are treated by this researcher 
as simulated authentic discourse for the following 
reasons: actors and actresses are native-speakers, 
and events take place in Russia. 


Video-Driven Course: An organization of 
instructional materials in which “most of the 
content of the print materials is related to the 
content of the video episodes (Van Patten et al., 
2004, p. 17). 


Videotext: A term coined by Joiner (1990) 
and currently used in L2 research; it implies 
that “television and video should be treated by 
researchers and practitioners as texts which are 
no less complex than a written text” (p. 54). 
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APPENDIX A 


Sample Quiz 2 (Immediate) 
Hauano: bu3Hec MO-MOCKOBCKH 


I. Circle the correct answer: 


1. B nogpe3ze pasropapuBaioT coceyHu: 
A. WUnesa Uneua 
b. Tarpana /[mMurpvesua 
B. Bosa 


2. Y HMX eCTb 
A. woutTa 
ac(pasibT 
B. mpoOsmema 


3. JloM HoBbIi, a HeT. 
A. Temedoua 
Bb. ayma 


B. accambta 


4. JleHa HuTye He MOKeT KYNUTb pe3HHOBBIe 


camorw. eé pa3mepa. 
A. eCTb 
Bb. HeT 
B. oguH 
Me ee OUCHb XOPOIO NOHMMAaeT H 
TaxK€ MO2KeCT TOMOUb. 
A. Jiokum 
BB. oayr 
B. Buxtop 
6. Moi OusHec Tak: 
A.  padotato 
b. padotaet 
B. padotaem 
7.  Kaxqoe ytpo 1 Bac 
3eCb. 
A. oKIY 
Bb. x#«xyéTe 
B. 2#*xéM 


8. WU kpacuBpie qeByliku 
__ camloru OecraTHo. 
A.  moury4aror 
b.  mpoyaror 
B. oryaroT 


II. Decide if a statement is true or false by 
circling either T or F: 


1. Buxtop: Y Mens ecTb pe3HHOBBIe carorn. 
T F 


2.  Buxtop: A mposaio pesuHosstie caroru 
T F 


3. Ha aproOycHol ocTaHoBKe »*xéT Apyr 
Buxrtopa. 
T F 


4. Bp ormaére emy canoru uw mmaTuTe cTo 
py Outer. 
T F 


5. larpcor pyOsel 3To Aoporo! 
T F 


6.  Ilatpcor pyOseli u y Bac rpa3Hble Typ 
T F 


7. Kpacwuppie Manbauku Mody4aroT canorn 
OecrmaTHo. 
T F 

8. Bor evicTBuTeIbHO O4eHb KpacnBas Je- 
ByIIKa. 
T F 


III. Complete the statements: 


Y coceyel ecTb 


Y HX HOBbIM JOM, HO HET 


Y Buxropa ect 
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Ou naéT canoru, HO OH HX He 


y eCTb JIpyr. 


Bbl WaTutTe MATBCOT 


3To He Joporo. UV y Bac uuctele Typin HW xopowee 


STO He AHcKpHMuHalnA. STO 


IV. Task types, item formats, and point alloca- 
tions are summarized below: 


Section Task Format Points Possible Points Earned 
I Recall Multiple Choice 8 
II Recognition True/False 8 
Ill Application Complete 8 
Total: 24 Total: 
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APPENDIX B 


Sample Recall Protocol Scoring Sheet 
Hauaso: bu3Hec n0-mockoscKu (Moscow Style Business) 


4-- Most important event 
1-- Least important event 
Idea Units: 15 

Total Points: 48 


Points 
Possible 


Idea Units 


Points 
Scored 


What a nightmare! How terrible! 


The house is new, but there is no asphalt. 


Lena cannot find rubber boots. They don’t have her size. 


All neighbors have a big problem. 


Viktor understands their problem and is ready to help. 


Viktor has a business. He has rubber boots of all sizes, but he does not sell them. 


Every morning he waits for the neighbors in the hallway and hands out rubber boots 
to them. 


Viktor’s friend is at the bus stop. He waits for the neighbors and takes the boots. 


The neighbors pay 500 rubles. 


They think it’s expensive. 


B)W)}W]w 


Viktor says that 500 is not expensive. For this money they get clean boots and good 
mood. 


Viktor says that pretty girls get the boots for free. 


Sasha thinks, its discrimination. 


Victor says it’s a joke. 


BRIM] NMI|N 


Viktor thinks that Lena is a very pretty girl. 


Most important: From Visual Clues 


Least important: From Discourse 
Number of Sentences 


Total: 
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Chapter IX 
Invested Mental Effort in an 
Aural Multimedia Environment 


Linda Jones 
University of Arkansas, USA 


ABSTRACT 


This study addresses the views of 9 students on the amount of invested mental effort (Salomon, 1983a) 
needed to effectively process multimedia annotations (pictorial and written) so as to learn from a sec- 
ond language (L2) aural passage. Initially, 67 college students in a second-semester French course 
listened to a multimedia based French passage. Participants were randomly assigned to one of four 
listening treatments that contained either no annotations, written annotations, pictorial annotations, or 
both annotation types. Follow up vocabulary production and recall protocol tests measured vocabulary 
learning and aural comprehension. From these 67 students, 9 were selected to participate in interviews 
based on treatment type and posttest results. After examining anecdotal information and test results of 
these 9 students, it appears that the amount of invested mental effort applied to processing different 
annotation types varied in its influence on their abilities to learn French vocabulary and on their aural 
comprehension. 


INTRODUCTION 


Research consistently has shown that processing 
written or pictorial information with an aural 
L2 passage enhances students’ comprehension 
and/or vocabulary learning (e.g., Carlson, 1990; 
Guillory, 1998; Mueller, 1980; Pouwels, 1992; 


Severin, 1967). For example, Mueller (1980) and 
Severin (1967) determined that access to pictures 
in an aural L2 environment better enhanced stu- 
dents’ performance on post-treatment measures 
than did the absence of pictures. More recently, 
Guillory (1998) determined that access to written 
subtitles in limited (one or two words) or expanded 
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(complete sentences) form supported students’ 
comprehension of video presentations. 

Research has also consistently shown that ac- 
cessing both pictorial and written annotations in 
a multimedia environment leads to greater aural 
or visual learning than when single or no annota- 
tions are available (e.g. Chun & Plass, 1996; Jones, 
2003, 2004; Jones & Plass, 2002; Plass, Chun, 
Mayer & Leutner, 1998, 2003). For example, 
Jones and Plass (2002) found that students who 
accessed pictorial or written annotations alone or 
combined while listening to a French text in an 
aural L2 multimedia environment outperformed 
those without access to any annotations, while 
those who accessed pictorial or written annotated 
information alone did not differ significantly in 
terms of their effectiveness for recognizing L2 
vocabulary. However, in terms of recall of the 
aural passage, those who accessed pictorial an- 
notations alone outperformed those without access 
to pictorial annotations. Plass et al. (1998) explored 
the effects of pictorial and written annotations 
on text comprehension and vocabulary acquisi- 
tion from a written German passage. Students 
who selected pictorial and written annotations 
while reading a German text performed better 
on comprehension and vocabulary tests than did 
those who accessed pictorial or written annota- 
tions alone or no annotations at all. The results 
of these and other L2 multimedia studies suggest 
that students meaningfully comprehend text (aural 
or written) in a multimedia format when they can 
select relevant pictorial and written information 
from it, organize the pictorial information into an 
understandable pictorial mental representation, 
organize the written information into an under- 
standable written mental representation, and then 
integrate these mental representations with one 
another by constructing referential connections 
(Mayer, 1997, 2001, 2002). 

The effects of students’ attitudes toward dif- 
ferent forms of media on their learning has been 
explored in recent years, primarily as it relates to 


written text and television (e.g. Cennamo, 1993; 
Cennamo, Chung, Leuck, Mount, & Turner-Vor- 
beck, 1995; Jones, 2003; Salomon, 1983a, 1983b; 
Salomon & Leigh, 1984). Most recently, Jones 
(2003) examined the effects of different annotated 
modes of information (pictorial and written) on 
students’ ability to recognize vocabulary from 
an aural L2 multimedia text. Jones’ (2003) study 
discovered that students’ attitudes and opinions 
toward these different processing modes may have 
affected their comprehension of the aural text and 
their recognition of vocabulary. However, in this 
study, Jones (2003) used simple multiple-choice 
recognition tests to measure students’ vocabulary 
acquisition. Some researchers (e.g. Cennamo, 
1993; Chang & Smith, 1991; Jones, 2006; Kelle- 
her, 1996; Salomon, 1984) have suggested that 
constructed response and inferential activities 
may be more sensitive measures for examining 
students’ attitudes and performance outcomes 
than multiple-choice measures like that used in 
Jones’ (2003) study. 

Therefore, to further understand the impact 
of multimedia on L2 learning, researchers must 
further examine the role students’ beliefs and 
expectations may have on their ability to process 
and learn from aural multimedia input. Specifi- 
cally, one must examine how students’ views on 
the amount of invested mental effort (AIME) 
(Salomon, 1983a) needed to process pictorial 
or written annotations in an aural multimedia 
environment may influence outcomes on vo- 
cabulary production and recall measures. This 
study explores these issues and begins with a 
brief review of pictorial and written processing 
strategies in a multimedia environment. It then 
examines the theory of invested mental effort and 
how students apply AIME to pictorial or written 
annotation modes. This study then concludes 
with an examination of the findings followed by 
the limitations and implications of this study for 
developers, teachers, and students, and sugges- 
tions for further research. 
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BACKGROUND 


Whether a particular medium or a particular 
annotation type makes a difference in learning 
depends not only on how it corresponds to the 
educational situation or the instructional design 
of the material, but also on the mental effort of the 
individual learners (Clark, 1983, 1994; Kozma, 
1991). Clark (1994), in particular, suggests that 
“students’ beliefs about their chances to learn 
from any given media are different for different 
students and for the same students at different 
times” (p. 23). Thus, the concept of AIME stems 
from the idea that students not only will have vari- 
able levels of information processing dependent 
upon the modality processed, but also that the 
amount of mental effort invested in a given task 
will not be solely dependent upon the input and 
its modality alone (Salomon, 1981a). This concept 
stems from Katz, Blumler, and Gurevitch (1974) 
who, long ago, commented that individuals access 
different forms of media for different reasons; a 
book for enjoyment or for knowing oneself better; 
a newspaper for the latest news and so on. Thus, 
“sources are composed of different parts, but we 
selectively anticipate certain parts that are distinc- 
tive to a source, often under weighing everything 
that is not within the selected parts” (Salomon, 
1981a, p. 127). We process information differently, 
with varying levels of depth, and the amount of 
mental effort students invest in learning, or “the 
number of nonautomatic elaborations applied 
to a unit of material” (Salomon, 1983a, p. 42) is 
influenced by how students view that particular 
source of information. If students believe that a 
particular medium is difficult, they may apply 
more nonautomatic energy toward processing 
the material and may learn more as a result. If 
they believe that a given medium is easy to work 
with, they may invest less energy and may learn 
less. Thus, students’ views of the easy or difficult 
nature of different forms of media may make a 
difference in learning outcomes. 
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Numerous researchers have examined dif- 
ferent perspectives on how AIME influences 
learning from television, video, and/or print (e.g. 
Cennamo, 1993; Kelleher, 1996; Meadowcroft & 
Olson, 1995; Mevarech, Shir, & Moskoritz-Hadar, 
1992; Salomon, 1983a, 1983b, 1984; Salomon 
& Leigh, 1984; Verhagen & Breman, 1995). 
Salomon (1983a, 1983b, 1984) and Salomon and 
Leigh (1984) used self-report questionnaires to 
determine the amount of mental effort invested 
by elementary students in processing television 
or print-based information. They found that 
students who perceived television to be easier 
than print invested less mental effort in learning 
from television than from print and therefore 
learned less while those who perceived text to 
be more difficult read the text-based material and 
performed better than did those who worked in 
a video format. Salomon and Leigh (1984) also 
examined time on taskas children processed print 
and television materials. They found that greater 
demand of a medium lead to higher AIME and 
learning and that inferential learning was higher 
than factual learning. However, their measure- 
ment of time on task suggested that it did not 
provide a good measure of effort since it was not 
possible to determine how focused students were 
while processing the different modalities within 
a specific timeframe. 

In a more recent study, Cennamo et al (1995) 
examined how students process video-based top- 
ics that were or were not familiar to them. Through 
follow-up interviews, the researchers found that 
students attempted to make connections between 
the new information and their prior knowledge 
of related topics; participants stated that they put 
forth additional effort to build a mental model of 
the new material from the bottom-up while they 
tapped into their schema in a top-down manner 
and called upon any existing knowledge present 
to process the new information. In this light, stu- 
dents’ AIME lead to enhanced learning because of 
connections made with students’ prior knowledge 
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or schemata; relevancy to the topic influenced how 
much mental effort was applied to the activity. 
Meadowcroft and Olson (1995) refer to this process 
of thinking about things that are relevant to the 
passage as ‘elaboration’. While Meadowcroft and 
Olson (1995) found that elaboration did not impact 
adult learners when processing television or print; 
others (Cennamo, 1993; Cennamo & Branlich, 
1996; Cennamo et al., 1995; Kelleher, 1996) have 
determined that when a passage is relevant to a 
person’s prior knowledge, then greater learning 
can occur. Simply put, “AIME leads to learning 
via its relationships to pre-existing schemata and 
ability to process information” (Kelleher, 1996, 
p. 10). Increased contact between old and new 
information, when done in a conscious, non-au- 
tomatic manner, is presumed to enhance learning 
(Cennamo, 1993). 

Using individual pictures and words, Jones 
(2003) examined the effectiveness of pictorial 
and written annotations on learning outcomes 
in a multimedia environment. Though this study 
did not specifically examine AIME, it was de- 
termined that students’ mental effort may have 
played a role in their performance on vocabulary 
recognition tests. Those interviewed believed that 
English translations were easier to process than 
images because of their immediate presentation 
of the translation needed. Images, on the other 
hand, demanded deeper processing in order to 
determine the appropriate translations of French 
words. Despite the “difficult” nature of images, 
students who accessed pictorial annotations 
outperformed those without access to such an- 
notations. The students who worked with images 
may have worked in a deeper, nonautomatic 
manner (Salomon, 1983a) and thus retained more 
vocabulary and incoming information. Those 
who worked with translations may have worked 
with less depth and analysis (Cohen, 1987) and 
retained less. Results suchas these raise questions 
about the potential differences between written 
and pictorial annotations. A written annotation 
is typically a one-to-one translation, perhaps a 


simple exchange from L2 to L1, as long as the 
student knows what the translation means. In 
addition, written annotations are free from other 
immediate distractions within the presentation of 
the word itself. Thus, students potentially have 
more room to focus in on the word leading to a 
decrease in the possibility of misinterpretation. 
As such, students also have room to visualize 
from the translation presented (Singer, 1980). 
Pictorial annotations, on the other hand, may 
not be an exact one-to-one translation and can 
be more complex. It is also possible that there are 
visual distractions within the pictures resulting in 
less room to focus purely on the actual point of 
the picture itself. There is also the possibility of 
misinterpretation if pictures are not contextually 
sound; some will also argue that there is also less 
room for visualization (Singer, 1980). 

Numerous researchers, over time, have also 
determined that certain testing strategies may 
further expose the effects of AIME on students’ 
learning (e.g. Cennamo, 1993; Kelleher, 1996; 
Salomon, 1984). Salomon (1984) found that a cor- 
relation between AIME and recognition strategies 
related to factual information was not significant 
whereas strategies that called on students to in- 
fer meaning were positively related to AIME to 
learning. In a meta analysis of numerous studies, 
Kelleher (1996) also found consistent evidence 
of inferential learning and AIME being much 
more strongly connected than AIME and factual 
information that had to simply be recalled or 
recognized. Thus: 


“When researchers are interested in assessing 
the effects of the mental effort learners use to 
elaborate on the content and create meaning from 
the materials, questions that require constructed 
responses may be a more sensitive measure than 
recognition tests” (Cennamo, 1993, p. 41). 


In addition to directing appropriate testing 


strategies toward the study of AIME, one can 
also use self-report measures which provide evi- 
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dence of mental effort voluntarily. Researchers 
can use dual-task methods which simultaneously 
combine a cognitive processing activity with an 
unrelated task such as tapping a toe or a finger, 
and/or can examine physiological changes such 
as how students move their eyes while processing 
input (Cennamo, 1993). 

Admittedly, many of these studies are quite 
old, evident in the fact that little follow-up analysis 
has been undertaken on this topic in recent years. 
Additionally, most studies related to AIME have 
been conducted on children and not on adults 
as learners (Meadowcroft & Olson, 1995) and 
all of these studies have focused on television 
or print. To this author’s knowledge, this theory 
has not previously been applied to any computer 
environment, much less an aural L2 multimedia 
environment. As such, this study serves as anew 
step in the analysis of students’ learning capabili- 
ties within today’s more elaborate L2 multimedia 
environment and fulfills a call made by Cennamo 
(1993) to investigate the effects of information 
processing, as offered by a computer, on students’ 
mental effort and achievement. A previous study 
(Jones, 2004) closely examined the statistical 
outcomes of the vocabulary production test of the 
present study inrelation to the interaction between 
annotation mode accessed and testing mode em- 
ployed. This current study minimally reintroduces 
this same statistical data in addition to new data 
from a recall protocol measure conducted on the 
same group of students, but instead more richly 
focuses on students’ mental effort when processing 
pictorial and/or written information. This mental 
effort is examined through the opinions of nine 
students as reported in post-treatment interviews, 
and their subsequent ability to produce rather 
than recognize vocabulary and to recall material 
from the aural passage. Thus, three hypotheses 
are proposed: 


Hypothesis 1: When asked to produce from 


memory individual keyword translations 
from an aural L2 passage, those who believe 
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that pictorial or written annotations are the 
easier medium with which to work will not 
put forth as much mental effort when work- 
ing with the reported “easier” annotation 
mode; and will not perform as well on the 
vocabulary production posttest as those who 
view either annotation type to be the more 
difficult mode to process. 

Hypothesis 2: When asked tosummarize the aural 
L2 passage in English, those who believe 
that pictorial or written annotations are the 
easier medium with which to work will not 
put forth as much mental effort when work- 
ing with the reported “easier” annotation 
mode; and will not will not perform as well 
on the recall protocol posttest as those who 
view either annotation type to be the more 
difficult mode to process. 

Hypothesis 3: When asked to produce from 
memory individual keyword translations 
from an aural L2 passage or to summarize 
the aural L2 passage in English, those who 
work without pictorial or written annota- 
tions will not perform as well on vocabulary 
production or recall protocol posttests as 
those with access to annotated information 
despite evidence of good mental effort being 
applied to the multimedia activity. 


THE PRESENT STUDY 
Participants and Design 


Sixty-seven second-semester beginning French 
students voluntarily participated in this study 
during their regular class time. All were fluent in 
English and were nonnative speakers of French. 
The students completed a 25-item vocabulary 
recognition pretest to determine their prior knowl- 
edge of the study’s vocabulary. All students had 
low prior knowledge of the vocabulary with an 
average score of 1.5 out of 25 (M= 1.57, SD= 1.23; 
Table 1). A Tukey HSD multiple comparison test 
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further revealed no significant differences among 
the four groups. 


Materials 


Four aural multimedia treatments, developed with 
Adobe Premiere 4.2 (Adobe, 1994) and Author- 
ware 4.0 (Macromedia, 1997), were presented to 
students using a 24-station Macintosh computer 
lab. Students were arranged so that they could 
only view their own computer screen. Within 
each multimedia module, all students first saw 
the opening screen that trained them to use the 
program and placed the aural passage in historical 
context. This screen was followed by five separate 
listening screens specifically designed for each 
treatment group. Within each screen, students 
could click on audio icons to listen to segments 
of the entire 2 minutes and 20 seconds aural read- 
ing of the authentic historic encounter between 
Monsieur de LaSalle and the Quapaw Indians as 
written in 1682 (Buzhardt & Hawthorne, 1993; 
see Appendix A). A total of 27 French words 
were placed in order of appearance on the left 
side of each screen. All students could hear the 
keywords pronounced by dragging them to a 
speaker icon located in the upper right segment 
of each screen. 

The four treatments differed as follows: In 
the control group, students only listened to the 
aural passage. In the pictorial annotations group, 
students listened to the aural passage and could 
drag keywords to a camera icon to view their 
pictorial representations. In the written annota- 


tions group, students listened to the aural passage 
and could drag keywords to a book icon to view 
their written English translations. In the pictorial 
and written annotations group, students listened 
to the aural passage and could drag keywords to 
either the camera and/or the book icon to view the 
pictorial or written translations of the keywords. 
Within each treatment, students could view any 
available annotated information before, during 
or after any aural segment. 


Dependent Measures and Scoring 


A written vocabulary production posttest exam- 
ined the effects of the four treatments on students’ 
vocabulary learning while a recall protocol post- 
test examined the effects of the four treatments 
on students’ comprehension of the passage. 
These tests were administered immediately after 
the treatment and again, as delayed tests, three 
weeks later. The written vocabulary production 
posttest was made up of 25 of the 27 French 
keywords present in the aural passage and visible 
on the five computer screens of each treatment. 
Students were required to provide the English 
translation for each of the 25 French keywords 
given. The maximum score for this test was 25 
with each correct response worth one point. The 
recall protocol posttest, administered immedi- 
ately after the vocabulary production posttest, 
required students to write all they could recall 
from the aural passage. The maximum possible 
recall protocol score was 69 with each correct 
proposition worth one point. 


Table 1. Vocabulary pretest results based on random assignments to four treatments 


Groups N M SD 
Control 16 1.69 1.45 
Pictorial Annotations 17 1.24 1.03 
Written Annotations 18 1.67 1.41 
Pictorial and Written 16 1.69 1.01 
Annotations 
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Procedures 


A pretest/posttest control group design was used 
to observe the effects of the absence or presence 
of pictorial and written annotations on students’ 
L2 vocabulary learning and aural comprehension. 
The study took place during three normally sched- 
uled class periods. During the first class period, 
students were given eight minutes to complete the 
multiple-choice vocabulary recognition pretest. 
Two days later, students were randomly assigned 
to one of the four treatments in the language lab. 
They were given 14 minutes to listen to the aural 
passage and to interact with any available anno- 
tated information. Students were then given eight 
minutes to complete the immediate vocabulary 
production posttest followed by eight minutes to 
complete the immediate recall protocol posttest. 
Three weeks later, without any additional contact 
with the aural passage, nor advance warning, 
students completed delayed vocabulary produc- 
tion and recall protocol posttests. The tests and 
timing strategies used were identical to the pre- 
vious tests given immediately after experience 
with the treatments. 


Qualitative Methods 

Participants 

Sixteen students were invited to participate in 
follow-up interviews based upon the treatment 


they experienced as well as the results on their 
posttests, so as to gain an understanding of the 


amount of invested mental effort applied to 
learning from images or from text. Nine students 
fulfilled this invitation and participated in the 
interview process (Table 2). 


Interviews & Data Analysis 


The interviews lasted from 20 to 45 minutes each 
and took place after all dependent measures were 
completed. During each interview, prepared ques- 
tions were used but were not strictly adhered to 
since interviewees often provided responses with- 
out prompting. All interviews were transcribed 
into the computer and were coded for analysis. 


RESULTS AND DISCUSSION 


Immediate Vocabulary Production 
Posttest Results (Jones, 2004) 


A 2x2 ANOVA, computed with the number of 
correct responses on the immediate vocabulary 
production posttest as the dependent measure 
and the presence or absence of pictorial and writ- 
ten annotations as the between subjects factors, 
revealed a main effect for written annotations, 
F(1,63) = 93.6, MSE = 1874.34, p < 0.001, "P= 
.998, for pictorial annotations, F(1,63) = 4.00, 
MSE = 80.17, p < 0.05, *P = 0.06; as well as an 
interaction effect for written and pictorial anno- 
tations, F(1, 63) = 5.07, MSE = 101.49, p < 0.05, 
'P = 0.074. Post hoc comparisons (Tukey HSD) 
revealed that the written annotations group did not 


Table 2. Number of students interviewed per treatment group 


Groups Number of Students Interviewed Per 
Treatment Group 

Control 2 

Pictorial 3 

Written 2 

Pictorial and Written 2 
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Table 3. Mean scores of the four treatment groups on the immediate and delayed vocabulary production 


posttest 
Groups N M SD 
Immediate Vocabulary Production Posttest Results 
Control 16 3.31 1.66 
Pictorial Annotations 17 8.47 3.48 
Written Annotations 18 16.33 5.29 
Pictorial and Written 16 16.56 6.05 
Annotations 
Delayed Vocabulary Production Posttest Results 
Control 13 2.77 1.09 
Pictorial Annotations 14 5.43 2.17 
Written Annotations 13 10.31 4.03 
Pictorial and Written 11 8.55 3.96 
Annotations 


differ significantly from those with access to both 
annotation types, p = .999. However the written 
annotations group and the pictorial and written 
annotation group did significantly outperform the 
pictorial annotations group, p < .001. All groups 
with annotations available to them significantly 
outperformed those without access to annotations 
(Table 3). 


Delayed Vocabulary Production 
Posttest (Jones, 2004) 


A 2x2 ANOVA, computed with the number of 
correct answers on the delayed vocabulary pro- 
duction posttest as the dependent measure and 
the presence or absence of pictorial and written 
annotations as the between subjects factors, re- 
vealed a main effect for written annotations, F(1, 
47) = 40.42, MSE = 367.4, p < 0.001, "P= .462, 
as well as an interaction effect for pictorial and 
written annotations, F(1, 47) = 6.8, MSE = 61.83, 
p < 0.05, *'P = .126. There was no main effect 
for pictorial annotations. Post hoc comparisons 
(Tukey HSD) revealed that students in the written 


annotations group did not differ from those with 
access to both annotation types, p=.489. Students 
with access to both annotation types and those 
with access to pictorial annotations differed only 
marginally, p = .063, while those with access to 
written annotations and those without access to 
any written annotations differed significantly, 
p < 0.001. Students with access to annotations 
outperformed those without access to annotations. 
However, the difference between those with access 
to pictorial annotations alone and those without 
access to any annotations was not significant, p 
= .115, Table 3. 


Immediate Recall Protocol Posttest 
Results 


A 2x2 ANOVA, computed with the number of 
correct propositions provided on the immediate 
recall protocol posttest as the dependent measure 
and the presence or absence of pictorial and writ- 
ten annotations as the between subjects factors, 
revealed a main effect for written annotations, 
F(1,63) = 30.27, MSE = 293.528, p < 0.001, "P= 


143 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Invested Mental Effort in an Aural Multimedia Environment 


Table 4. Mean treatment group scores on the immediate and delayed recall protocol posttest 


Groups N M SD 
Immediate Recall Protocol Posttest 

Control 16 3.25 3:57 
Pictorial Annotations 17 6.65 3.02 
Written Annotations 18 7.22 2.65 
Pictorial and Written 16 11.06 3.21 
Annotations 

Delayed Recall Protocol Posttest 

Control 13 1.85 1.57 
Pictorial Annotations 14 3.79 1.63 
Written Annotations 13 4.46 2.76 
Pictorial and Written 11 6.45 2.98 
Annotations 


.325, and for pictorial annotations, F'(1,63)=20.37, 
MSE = 197.586, p< 0.001, 'P=.244. There was no 
interaction effect present for written and pictorial 
annotations. Post hoc comparisons (Tukey HSD) 
revealed that students in the no annotations group 
differed significantly from all other groups as did 
those who worked with both pictorial and written 
annotations, p < .05. Those with access to both 
annotation types significantly outperformed the 
written annotations group and the pictorial an- 
notations group, p < .004. However, the written 
annotations group and the pictorial annotations 
group did not differ from each other, p = .947; 
see Table 4. 


Delayed Recall Protocol Posttest 
Results 


A 2x2 ANOVA, computed with the number of 
correct answers on the delayed recall protocol 
posttest as the dependent measure and the pres- 
ence or absence of pictorial and written annota- 
tions as the between subjects factors, revealed a 
main effect for written annotations, F(1, 47) = 
17.01, MSE = 88.328, p < 0.001, 'F = .266, and 
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for pictorial annotations, F(1, 47) = 8.0, MSE = 
41.58, p < 0.007, 'P = .146. There was no interac- 
tion effect present. 

Post hoc comparisons (Tukey HSD) revealed 
that students in the control group were signifi- 
cantly outperformed by all groups except for the 
pictorial annotations group, p = .135. However, 
the pictorial annotations group also did not differ 
significantly from the written annotations group, 
p=.868. Those who worked with both annotation 
types outperformed all groups without access to 
written annotations, p < 0.03 (Table 4). 


STUDENTS’ REPORTED MENTAL 
EFFORT 

In this study, students were asked to discuss the 
mental effort they used when working within the 
aural multimedia environment. 


Treatment without Annotations 


The interviewees for the treatment without an- 
notations group were Myriaand Mary Alice, both 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Invested Mental Effort in an Aural Multimedia Environment 


of whom received a score of three on the recall 
protocol test; on the vocabulary production test, 
Myria received a 3 out of 25 and Mary Alice, 
a 4 out of 25. By default, the treatment without 
annotated information was presumed to be the 
most difficult, and students who participated in 
it not only performed poorly, those who were 
interviewed clearly indicated the struggles that 
they faced and the mental effort they applied 
to try and overcome the difficult nature of this 
modality. 

Myria commented that she tried to understand 
the aural passage: 


“T started listening to it over and over again and 
kept listening for things that I thought I might 
recognize, words that I’ve seen before. So, I think 
I just listened to it over and over again but I have 
no idea...” 


Unfortunately, she was not as successful as 
she would have preferred: 


“Twas really confused about that [the passage]... 
it was just a bunch of French and I didn’t have a 
question that asked me to look and see what they 
are going for here.” 


The lack of advance organizer information in 
the form of a question, a potentially helpful aid 
that can guide students in their processing of a 
passage and their subsequent comprehension (¢.g., 
Herron, 1994; Herron, York, Cole, & Linden, 
1998), prevented her from understanding the aural 
message. Despite this, Myria made an attempt 
to build a relationship between the material and 
her prior knowledge and tried to visualize while 
listening to further her comprehension: 


“T kept thinking about what they had told us in the 
beginning is going on about the French explorers 
... what does that look like to meet them ... some 
of the Native Americans and British people ... I 
kinda had this vision of guys on a canoe coming 


in or guys on horses. So, I kept trying to visualize 
or think about which one of these passages would 
connect with that. I was trying to think about 
where the story was set and stuff and what they’d 
be doing ... what would make most sense.” 


Myria also tried to listen to the passage in 
chunks to help her comprehend the aural infor- 
mation: 


“T listened to each paragraph [sentence] twice in 
a row instead of go to the next page ... I thought 
I’d focus on it more because just listening to the 
whole thing, I had no idea.” 


Chunking is normally a beneficial learning 
strategy. That is, learners actively construct 
meaning by chunking what they hear or read 
into meaningful units. They then use their prior 
knowledge to organize the relevant information 
to fill in gaps in the passage presented. This helps 
them comprehend the material and integrate it 
into their knowledge already in memory (Long, 
1989; Mayer, 1992; O’ Malley, Chamot, & Walker, 
1987). In the end, what is generally retained in 
long-term memory is “a representation of their 
understanding of the general message of a text 
supported by salient details which reinforce that 
message” (Fischer & Farris, 1995). Chunking, in 
this instance, didnot help Myria’s comprehension. 
She simply could not overcome the difficult nature 
of the text to help her understand the passage and 
learn vocabulary. 

Mary Alice also experienced the aural passage 
without annotated information and approached the 
task using a bottom-up strategy: “I tried to look 
for words that I recognized from sight and guess 
what was going on.” That is, she tried to absorb 
any information she could from the visible French 
keywords. Unfortunately, she too felt unsuccess- 
ful: “I felt like I didn’t really know ... I got the 
very basic part of what was going on but I didn’t 
understand it.” Though she did not have access 
to annotated information, Mary Alice was able 


145 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Invested Mental Effort in an Aural Multimedia Environment 


to visualize as she listened to the aural passage: 
“T pictured water, and a valley, meeting and not 
really understanding each other.” She also thought 
of relevant topics as she listened to the text, “I 
thought about all of the pictures of Indians that 
you see, of how they lived, but not any one in 
particular,” but eventually lost her focus: 


“It wandered a little bit when I didn’t really un- 
derstand, after I’d listened through it a couple of 
times, let it go because I didn’t understand it, but 
I was focused when doing it.” 


Without annotated information, Mary Alice 
and Myria had to put forth additional effort in a 
variety of ways, (visualization, referential con- 
nections or elaboration, repetition of the passage 
in smaller chunks, bottom-up processing), to try 
to understand the aural passage. Despite these ef- 
forts, comprehension was beyond their grasp and 
their focus faltered: “I thought I knew what was 
happening ... but when I didn’t really have a clue 
of what was going on and I’d already listened to it 
twice, then it was like, okay! That’s when I started 
losing my attentionspan” (Myria). Theirincreased 
mental effort did not increase achievement on 
either dependent measure (Salomon, 1983b). The 
students couldnot overcome the difficultnature of 
the lesson even if they did increase their mental 
effort: “Simply expending more effort does not 
guarantee increased achievement when learners 
are unable to create a coherent mental model of 
the content” (Cennamo, 1993). 


Treatments with only Pictorial 
Annotations Available 


The interviewees for the treatment with only picto- 
rial annotations available were Stan, Jennifer, and 
Noreen, who utilized these annotations in an effort 
to support their understanding of the aural mate- 
rial. When Stan accessed pictorial annotations, 
his strategy was to listen to the passage several 
times to get an overall gist of the text and also 
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to fill in gaps that were missing. He thus utilized 
both top down and bottom up strategies: 


“T listened to the story three or four times to try 
and review the vocabulary and see if I could 
pick up anything else ... if I didn’t understand 
everything, just try to get the main gist of the 
story and then go back and put together what 
happened before.” 


Stan believed that one had to work harder to 
learn vocabulary from English translations than 
from pictures: 


“When you are shown a picture, you can infer 
whatever you want to... you aren’ really search- 
ing for the right meaning ... but if you are given 
the translation you still have to work harder than 
with the picture. You’d have to visualize it ... 
a picture can put more than one idea together, 
you know, the whole paragraph together in the 
picture instead of just one word ... you have to 
think of words more deeply than pictures ... with 
the pictures you can embellish.” 


Stan did not have access to written annota- 
tions but believed that pictorial annotations can 
complement the language and real world presented 
(Baggett, 1989; Kozma, 1991), and can therefore 
bemore efficient for learning vocabulary than can 
written annotations (Oxford & Crookall, 1995). 
He also commented that he remained focused 
throughout the listening process and that he did 
visualize as he processed the aural text: “I visual- 
ized or tried to visualize the whole story of what’s 
his name coming along the river and stopping and 
the Indians and what’s going on.” 

In terms of the mental effort needed to work 
with annotations, Jennifer felt that English transla- 
tions would be easier and more helpful for learning 
the vocabulary than pictures: 


“When I see that word, it is faster. When I see an 
image, I have to work harder like some of those 
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pictures I couldnt figure out what they meant 
... For example, something about people sitting 
down. I didn’t know if it was “sit” or “bottoms” 
or what.” 


She stated that she prefers working with words 
and suggested that pictorial annotations demanded 
deeper processing strategies than do written an- 
notations in order to enhance knowledge (Jones, 
2003). She also stated that she listened “a bunch of 
times” and tried to build bridges from one word to 
the next using the pictorial information presented 
but didnot understand all of the pictures accessed. 
She did not visualize as she processed the passage 
but did think of some things that were related to 
the topic, such as Indians and swords. 

Noreen, on the other hand, felt that pictures 
would be very helpful for learning vocabulary, 
more so than word translations: 


“whenever I see them [pictures] I remember it 
better thanjust seeing words... [knowin our book 
in the very beginnings of the chapters whenever 
we have all that stuff, whenever we take a test, I 
always can see the words in the pictures and then 
I can not always just remember a word with its 
English translation beside it.” 


In examining their vocabulary production 
scores, three varied results are present, in com- 
parison to their comments: Jennifer received a 13 
out of 25, Noreen a 12 out of 25 and Stan, 8 out 
of 25. Jennifer may have expended more mental 
effort with the pictorial information since she 
believed that images demanded deeper processing 
than words. On the other hand, Stan, who believed 
that images were easier to process and recall, 
may have exerted less mental effort and therefore 
learned less vocabulary as aresult. These findings 
thus might indicate that the students’ amount of 
invested mental effort may have affected their 
knowledge of new vocabulary. Noreen, however, 
labeled herself as a visual learner and relied on 
her learning strength in combination with the 


relevant pictorial annotations. She thus proved to 
beas successful on the vocabulary test as Jennifer 
who felt that pictorial annotations were a greater 
challenge for learning vocabulary. 

Students were also asked to discuss the mental 
effort put forth during their review of the mate- 
rial in order to recall the aural passage. Noreen 
believed that processing images would be more 
challenging since with a picture “I don’t know 
what it is trying to get across.” Thus, for recalling 
the passage, she stated: 


“For that one, words might have been better ... 
I had a gist of what was going on but I didn’t 
know for sure if I was translating the picture 
correctly.” 


Throughout the passage, she did visualize 
certain aspects of the text such as a camp fire and 
a gathering and did think about relevant topics: 


“T thought about Oklahoma just because I know 
there’s a lot of Indian stuff there and in the past, 
learning about tribes and the feathers and all 
that stuff.” 


Stan believed that images would be easier to 
work with and thus would be more beneficial for 
recalling the passage than would words: 


“Tfyouare trying to understand the story, pictures 
would be good ...a picture can put more than one 
idea together, you know, the whole paragraph 
together in the picture instead of just one word 
... if you are given the translation you still have 
to work harder than with the picture. You’d have 
to visualize it. Because you’d have the word but 
then you’d have to visualize it... you have to think 
of words more deeply than pictures.” 


Jennifer, who stated that she rarely visualizes 
when reading in general, found pictures to be a 
great challenge for comprehending the aural pas- 
sage: “I was trying to figure out what they were 
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... some of them I just didn’t even know what it 
was ... they totally confused me.” Interestingly, 
Noreen scored seven on the recall protocol test 
even though she felt that images would demand 
more processing than words while Stan, who felt 
that images would be more helpful and easier, 
actually scored 12 on his recall protocol test. Jen- 
nifer, who felt the greatest challenge from visual 
annotations, only scored four on herrecall protocol 
test. In this instance, the theory of the amount of 
invested mental effort was not supported and did 
not have an effect on their comprehension of the 
aural passage as hypothesized. Instead, Stan may 
have had more motivation and interest in working 
with images than with text since he believed that 
images would allow him to build a story, to infer 
meaning, thus rendering a picture worthy of “a 
thousand words.” Noreen, on the other hand, saw 
pictures as individual one-to-one word transla- 
tions suggesting thatshe was not building meaning 
from the aural passage but instead was relying 
on bottom up, factual information as she listened 
and processed the images. Jennifer was not able to 
overcome the difficult nature of images and thus 
did not comprehend the passage well. 


Treatments with only Written 
Annotations Available 


Students in this treatment included Zula and Su- 
zanne, both of whom only had access to written 
annotations. In discussing her processing strategy, 
Zula stated: 


“T went through it once relatively quickly, looking 
up the words and just listening to it. I went back 
and did it a little more slowly, each page, mak- 
ing sure I understood, so it was kind of a broad 
scope and then go back and understand more 
little things.” 


Zula was approaching her listening compre- 


hension activity from both a top-down and bot- 
tom-up direction and also tried to infer meaning 
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so as to better understand and recall the aural 
passage. She also believed that words would “force 
her” to work harder when trying to understand 
the aural passage: 


“T think a word you have to read in between the 
words that aren’t there ... you have to think more; 
if I had the pictures, I wouldn't think as much into 
it probably. So, I wouldn’t be analyzing as much 
... 1 don’t think I'd think as deeply into it.” 


Suzanne also used a listen and review strategy, 
along with top-down and bottom-up processing, 
to help her build connections between the words 
and the different aural segments so as to under- 
stand the passage: 


“Td get the gist of the first couple of sentences 
and then there’d be one I wouldn’t know what 
they were referring to. So then I could go look 
up the meaning of that word and gather the 
meaning from previous sentences and that one. I 
could make connections ... I could get little bits 
of it with that one translation, I can put the whole 
word or the whole sentence together just with 
that one word.” 


Suzanne further remarked that it was easier 
to learn from words and that one would have to 
spend more time working with pictures to acquire 
vocabulary: 


“A word is more to the point. There are too many 
things you don’t know about that picture, what 
they’re wanting.... But with words, you’re given 
what you want.” 


Both Zula and Suzanne indicated that they 
visualized as they listened to the aural passage: 


“T pictured the whole story, the canoe pulling out, 
the canoe to the shore with the warriors, their 
feathers, their dancing around the big pole with 
something” (Zula). 
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and that they made relevant connections between 
the passage and their own lives: 


“T like going canoeing and considering that we’ve 
gotten stuck on sand banks I could see that ... 
considering that I live in the country I could see 
some of the imagery” (Suzanne). 


Both women also stated that they remained 
focused throughout their experience with the 
aural passage, and Zula even commented that 
“the pictures are still in my mind, the words are 
not.” Suzanne’s commentregarding the interactive 
nature of multimedia was particularly striking: 


“TI was focused, the only time I usually wander is 
when I’m listening to lectures instead of reading 
things ... you had the listening and you had the 
written in front and it was more participation 
instead of listening to someone lecture.” 


Suzanne believed that words would be most 
helpful for recall and tried to build bridges between 
words and segments to help her understand the 
aural passage. However, she did not perform as 
well as Zula and received a seven on her recall 
protocol test. Zula, who believed that words were 
more difficult to process than pictures, received an 
above average score of 14 on her recall protocol 
test. Thus, the effects of AIME may well have 
affected their aural comprehension. 

In terms of learning vocabulary, Suzanne 
believed that words would be the most helpful 
for learning vocabulary. Zula, on the other hand, 
felt comfortable with both types of modalities 
but believed that words forced her to dig deeper 
for meaning: 


“T do pay attention more to words than pictures if 
I’mtrying to learn something just because words 
take more for me to delve into it than do pictures 
... words take longer for me to think about than 
the pictures ... there are so many different words 
and so many different ways to say something.” 


Both Zula and Suzanne received an 18 on their 
vocabulary production test. Unlike students in 
the treatments with pictorial annotations, Zula 
and Suzanne did not have to “translate” an im- 
age into text since the English translation was 
available to them. They more exactly produced 
correct responses in the vocabulary production 
tests than those who worked with pictorial annota- 
tions alone. Therefore, the influence of the amount 
of invested mental effort, at least for these two 
students, may have diminished in importance in 
terms of vocabulary recall since the testing mode 
employed (written) complemented the written 
annotation mode accessed (Jones, 2004). Thus, 
in this instance, the hypothesis regarding AIME 
and vocabulary learning is not supported. 

The efforts of all students who accessed 
single annotations (pictorial or written) is further 
seen in their timed log files which measured the 
amount of time that elapsed from first accessing 
an annotation to the appearance of the next one. 
On average, students spent an equal amount of 
time accessing the individual annotations pro- 
vided (Pictorial Annotations M = 10.98 seconds 
per annotation; Written Annotations M = 11.21 
seconds per annotation). Despite equal access 
as indicated by time on task, students who only 
accessed pictorial annotations could not produce 
English translations of the keywords as well as 
those who only accessed written annotations, 
further suggesting that the written vocabulary 
production test may have had a greater effect on 
learning outcomes than did students’ mental effort. 
Students who accessed only pictorial annotations 
could not construct or produce a coherent writ- 
ten representation of the pictorial material given 
(Cennamo, 1993) evenif they put forth significant 
effort in processing pictorial annotations. 


Treatment with both Pictorial and 
Written Annotations 


Students with access to both pictorial and written 
annotations included Vera and Roger who selected 
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from the annotations based solely on their pref- 
erences. Vera believed that images would more 
easily help her to learn the vocabulary but that 
images, along with text, would make the incom- 
ing information more meaningful: 


“Memorizing vocabulary is harder if you have 
to look at a French word and then look at the 
English word. Whereas if you have a picture I 
think it’s easier. I think somehow it’s just that 
scenes are easier to remember than words. If 
it’s a word that doesn’t remind you of any word 
in English if you have a related picture to it that 
would be easier.” 


Vera scored 18 out of 25 on the vocabulary 
production test while her annotation selection log 
revealed that 68 percent of all of the annotations she 
accessed were written annotations. She therefore 
processed more written annotations than pictorial 
annotations, amore mentally demanding strategy 
for her to follow, but yet performed above average 
on the vocabulary production test. 

Roger also accessed both annotation types and 
felt that words would be more helpful for learning 
the vocabulary: “I’d probably just pick the words 
because the word is more definite and tells me 
exactly what it is in English but the picture it may 
have several things.” He believed that one has to 
work harder to understand a picture than a word: 
“A word translation just defines it, it defines the 
French word but the scene ... You have to figure 
out what they are talking about in that scene.” 
Overall, Roger performed poorly on the vocabu- 
lary production test and received a score of 6 out 
of 25, well below average for his particular group. 
In an examination of his annotation selection log, 
70 percent of all of the annotations he selected 
were written annotations. He felt that the written 
mode was easier to learn from and therefore may 
have expended less energy with this annotation 
type, resulting in his poor performance on the 
vocabulary production posttest. Thus, in the case 
of these two students, the hypothesis regarding 
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vocabulary acquisition and the effects of AIME 
is well-founded. 

Those who accessed both annotation types 
also had preferences for one annotation mode 
over another for supporting recall of the aural 
passage. Vera, who scored the highest among 
all 67 participants on the recall protocol test, an 
18, believed that pictures were better than text 
for recall: 


“Tf you have a picture even if you had just sort of 
a big picture like a painting of what was going I 
think it’d be much easier and much faster than if 
you had to like look up every word that you did 
... The pictures really, really helped more than the 
words ... we had to summarize what happened it 
was much easier to think about the sequence of the 
pictures than to try to remember the words.” 


Roger, who received an average score on the 
recall protocol test, a 12, was unsure about which 
annotation type was most helpful for recall: 


“The pictures would probably give you a better 
idea of what was actually going on. But the words 
would specify more of a certain part. I don’t know 
probably the pictures would give youa better idea 
because they are not just talking about one word, 
you know ... it shows you a picture it shows say 
the camp ground, a scene ... so maybe it was the 
pictures.” 


Roger did not have a clear feeling about the 
mental effort needed to process either annotation 
type to understand the aural text. However, if he 
was more concerned with learning words than 
comprehending the passage, then his actions 
and efforts may have led more toward accessing 
vocabulary words for meaning rather than com- 
prehension. Vera, on the other hand, found words 
to be more challenging but nevertheless most often 
selected them to help her build referential con- 
nections between the two types of information to 
recall the aural passage. She not only learned the 
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vocabulary by working with the “more difficult” 
annotation type, she also gained knowledge of the 
passage by using this same strategy. 

Other issues of mental effort including stu- 
dents’ ability to visualize and thus make relevant 
connections with the aural material, the annota- 
tions, and their prior knowledge may have also 
played a role in whether or not students meaning- 
fully learned the material presented (Cennamo, 
1993; Cennamo et al., 1995). Vera, for example, 
did think of relevant topics as she processed the 
passage: “whatever I learned in Arkansas history 
and elementary school about the Quapaw or what- 
ever...” Roger, in particular, richly visualized the 
incoming information, despite his preference for 
working with words: 


“In this I saw LaSalle on the Arkansas River ... 
I visualized that, I live in the Ozarks so I’m used 
to creeks, and I visualized him coming up on the 
sand bar, meeting the Indians and taking them to 
the camp. Pretty much everything I understood I 
saw what it would be like.” 


Thus, on a cognitive processing level, the 
relevance of the passage to prior knowledge, and 
Roger’s mental effort to connect the two, seemed 
to be crucial for enhancing his motivation and 
understanding of the aural passage. Salomon 
(1981b) argues that mental effort has not only 
cognitive processing embedded within it but 
also motivational components. If students are 
motivated, they will expend more mental effort; 
if they are not motivated, mental effort will be 
less. Therefore, making conscious, non-automatic 
connections between previous knowledge and 
what was experienced may have made a differ- 
ence in comprehension: 


“The increased contact with the learner ’s mental 
schemata that results from the conscious, non- 
automatic generation of elaborations, or mental 
effort, is presumed to facilitate the retention 


and retrieval of the new material” (Cennamo & 
Braunlich, 1996, p.126). 


Roger demonstrated great strength of relevance 
between the passage and his schema. While av- 
erages in all groups dropped between the initial 
recall protocol and the delayed recall protocol, 
Roger earned the exact same score (12) on both 
the immediate and the delayed recall protocol 
tests, a score that was well above average for the 
dual-annotations group. 


SUMMARY 


As with previous studies on aural comprehension 
in a multimedia environment (Jones, 2003, 2004; 
Jones & Plass, 2002), we see that students most 
often performed best on vocabulary production 
and recall protocol tests when they accessed 
both pictorial and written annotations. Students 
performed poorest when neither annotation type 
was available. However, unlike previous studies 
where pictorial annotations had a stronger effect 
on vocabulary learning, especially in terms of 
“recognizing” vocabulary, (Jones, 2003; Jones 
& Plass, 2002), written annotations had a greater 
effect on “producing” vocabulary. 

Students’ comments concerning their invested 
mental effort revealed that the hypotheses in 
this study were at times supported, at times not 
(Table 5). 

Those without access to annotations could not 
overcome the difficult nature of their treatment 
and thus performed poorly on both the vocabu- 
lary production and the recall protocol tests. The 
characteristics of the tests and their treatment 
influenced the effects ofstudents’ invested mental 
effortsuch that they could not build a mental model 
of the incoming material and thus interpret it into 
meaningful learning (Cennamo, 1993) despite the 
fact that the students interviewed used a variety 
of different processing strategies. Hypothesis 3 
was thus supported. 


151 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Invested Mental Effort in an Aural Multimedia Environment 


Table 5. Summary of hypotheses tested and supported 


Subject Annotation Hypothesis Tested/ 
Supported 

Myria None H3/Yes 

Mary Alice None H3/Yes 

Stan Picture H1/Yes; H2/No 
Jennifer Picture H1/Yes; H2/No 
Noreen Picture H1/No ; H2/No 
Zula Written H1/No; H2/Yes 
Suzanne Written H1/No; H2/Yes 
Roger Both H1/Yes; H2/Yes 
Vera Both H1/Yes; H2/Yes 


Interviewees with access only to pictorial 
annotations had differing opinions concerning 
the effects of pictorial or written annotations for 
learning vocabulary. Stan believed that pictorial 
annotations were easier to process than written 
annotations and did not perform as well on the 
vocabulary production test as did Jennifer who 
felt that pictorial annotations were the more 
difficult annotation type. Noreen, on the other 
hand, displayed great confidence in the connec- 
tion between her learning style and access to its 
relevant annotation type and fared very well on 
the vocabulary production test. Thus, Stan may 
have expended less mental effort with the “easier” 
pictorial annotations and performed less well than 
Jennifer who expended greater mental effort with 
what she perceived to be more challenging an- 
notation mode, reinforcing the theory of AIME. 
Noreen, however, presented an alternative angle 
and her results and comments suggested that 
AIME didnot play a partin her learning. Interms 
of recall, AIME was not supported as students’ 
opinions of pictures as single-focus items or as 
parts of a story seemed to influence how much 
they learned. That is, though it was believed by 
Noreen that images would be more demanding, she 
did not perform as well given her attitude toward 
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pictures as providing a one-to-one translation of 
a word. Stan, on the other hand, saw images as 
providing inferential support and was able to grasp 
a more holistic view of the aural text as a result. 
Jennifer, however, felt images too complex to 
help her comprehend the passage and thus poorly 
recalled the passage. 

Interviewees with access to only written an- 
notations revealed a completely opposite result 
from those who accessed pictorial annotations. 
That is, no matter their views on the challenges 
of written or pictorial annotations for learning 
vocabulary, the outcomes of the interviewees were 
identical. Thus, the influence of AIME was not 
supported but instead, a connection between the 
modality accessed (written) and the testing mode 
used (written) may have enhanced the ability of 
students to more equally learn from written an- 
notations. On the other hand, we see evidence of 
AIME when processing written annotations for 
comprehension in that Zula who believed written 
annotations were more difficult to help process the 
aural text outperformed Suzanne who believed 
that written annotations were easier to process. 

Though students who worked with pictorial 
or written annotations alone expended almost the 
same amount of effort reviewing the annotations, 
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those who accessed written annotations sig- 
nificantly outperformed those who accessed only 
pictorial annotations onthe vocabulary production 
test. Despite the fact that equal mental effort was 
put forth in terms of time on task, the students 
who worked with images alone were unable to 
overcome the difficult nature of the vocabulary 
production test and thus failed to supply as many 
correct answers. In this instance, the rate of forget- 
ting was not “a function of the lack of depth and 
analysis” (Cohen, 1987, p. 45), but was instead 
related to the testing mode employed. 

Interviewees who accessed both annotation 
types also unveiled the theory of AIME in terms 
of vocabulary recognition. Again, when access- 
ing what was stated to be the more difficulty 
annotation type, learning was higher than when 
an individual stated that he accessed the easier 
annotation type. However, in terms of recall, the 
most meaningful result stems from Roger who, 
despite performing poorly on the vocabulary 
production test, was motivated by the passage, 
made connections with his prior knowledge 
through visualization of scenes from his home, and 
maintained the exact same score on the recall and 
delayed recall tests. No other students maintained 
this same level of comprehension. 


IMPLICATIONS 


This study offers practical and theoretical implica- 
tions. Concerning practical implications, the value 
of giving students access to multiple annotation 
types in an aural L2 multimedia environment is 
well-founded since information in two different 
modes (pictorial and written) most often enhances 
students’ learning (Chun & Plass, 1996). Thus, 
as technologists design and develop L2 multi- 
media materials, giving students an opportunity 
to choose the mode of information they prefer 
may help them better learn the vocabulary and 
comprehend the material. However, educators and 
technologists should also consider strategies for 


developing and utilizing materials that encour- 
age students to review what they perceive to be 
the more challenging material so as to encourage 
them to potentially use more mental effort as 
they process input. In other words, instructional 
designers and educators must find ways to get 
students to maximize their effort no matter the 
annotation types provided. Suchstrategies should 
also ensure that connections are some how made 
with students’ prior knowledge to further support 
learning. This is supported by the question of 
relevancy. That is, when a passage is relevant to 
a person’s prior knowledge, then greater learning 
can occur since “AIME leads to learning via its 
relationships to pre-existing schemata and ability 
to process information” (Kelleher, 1996, p. 10). 

On the theoretical side, this study also adds 
additional thought to the literature concerning the 
amount of invested mental effort students apply 
when learning from pictures or from words. At 
times, students who believe that an annotation 
type is more difficult to process may well apply 
more mental effort to the annotated information 
and subsequently learn more, while students who 
believe that a particular annotation type is easier 
to process may well apply less mental effort to 
the annotated information, resulting in less learn- 
ing. However, this study further suggests that 
students who express a connection between their 
preferred learning style and the annotations pres- 
ent may well expend additional effort by virtue 
of comfort with the learning task thus bringing 
to the forefront a new question of mental effort 
not seen in previous AIME studies. 


FUTURE RESEARCH 


Results in this study were interestingly mixed 
in that a consistent pattern of AIME did not 
emerge across the different treatments. Also, 
this is not an extensive study and as such we can 
only make comments on students’ mental effort 
based on what a small number of individuals have 
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said or experienced. Despite the low numbers of 
interviewees, evidence of a mental effort effect 
exists under certain conditions. This beginning, 
therefore, is quite important as it reveals several 
of the intricacies, including visualization, refer- 
ential connections or elaboration, repetition of the 
passage in smaller chunks, relevancy to learning 
style, top-down and bottom-up processing, which 
we must continue to trace as we develop CALL 
materials for our students. Thus, based on results 
and comments in this study, researchers should 
develop a more extensive AIME assessment tool 
that addresses these different nuances that emerge 
when students put forth mental effort to process 
a given annotation type. Future research that 
thoroughly examines students’ amount of invested 
mental effort in a manner that focuses in on all 
participants of a study is also a next logical step as 
this may well provide more statistical and quali- 
tative evidence as to the mental effort students 
apply toward pictorial and written annotations 
in an aural multimedia environment. Research- 
ers should also examine how students process 
individual pictures and how they foresee their 
usefulness in terms of providing individual versus 
holistic information. For that matter, researchers 
should also further explore why students perceive 
annotated information differently and also should 
compare the different processing strategies that 
exist when students process aural, written and 
pictorial information. 
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KEY TERMS 


AIME: Amount of invested mental effort. 
This theory examines “the number of nonauto- 
matic elaborations applied to a unit of material” 
(Salomon, 1983a, p. 42). Such elaborations are 
influenced by how students view a particular 
source of information. 


Annotations: Visual and verbal supple- 
mentary items, such as a word translation or a 
visual representation of a particular word, that 
are intended to provide additional meaning to the 
listening passage. These are accessed through the 
selection of keywords presented on the computer 
screen. 
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Choice: Students’ ability to make decisions 
about how they view the material presented. In 
other words, if they prefer to view the material 
with visual and verbal annotated support, or prefer 
to review any segment of the passage, such op- 
tions are available. 


Comprehension: The ability to understandthe 
primary propositions of a listening comprehen- 
sion passage. However, this is not meant to entail 
the understanding of every word of the passage. 


Keywords: Selected words from the aural 
passage that are presented on the computer 
screen. They are used to access the annotated 
information. 


Propositions: Individual idea units present in 
a listening or a reading passage. 


Recall Protocol: A test in which students 
indicate their level of comprehension of the 
material presented by summarizing, in their na- 
tive language, all that they understood from the 
listening passage. 
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APPENDIX A 


Text of Listening Comprehension 
Passage 


LaSalle Meets the Quapaws (1682) 


On fit traverser les canots sur la gauche a une pointe 
de sable. On se retranche le mieux que |’on peut 
avec des petits bois de tremble, qu’on coupa, dont 
on fit des palissades. La brume se cessa, et l’on vit 
un canot de Sauvages veniranous ... Mais voyant 
qu’on ne leur en tirait point, ils s’en retournérent 
chercher dire que c’étaient des gens de paix. IIs 
revinrent 6 sans armes avec le calumet de paix 
faisant signe qu’on vienne a leurs habitations. IIs 
présentérent a fumer a M. de LaSalle et a tous 
ceux qui étaient autour de lui disant toujours qu’on 
s’embarque ... Le lendemain les guerriers et la 
jeunesse dansérent le calumet. C’est de s’assem- 
bler tous sur la place. Les guerriers mettent leur 
présents sur des perches comme quand on veut 
faire sécher du linge. Ils apportent deux grands 


158 


calumets enjolivés de plumes de toutes couleurs 
et pleins de cheveux de leurs ennemis. Ils mettent 
tout cela entre les mains de leurs chefs qui sont 
assis sur leurs culs et arrangés autour de la place. 
Ils ont tous des gourdes pleines de cailloux et des 
tambours qui sont des pots de terre. Ils commen- 
cent une chanson qu’ils accompagnent du bruit 
de leurs instruments. Les guerriers qui ont fait 
de belles actions vont danser et frapper un poteau 
avec leurs casse-téte et disent les belles actions 
qu’ils ont faites ... cependant les chefs fument, 
Pun aprés l’autre dans les calumets, et chacun le 
présentait a M. de LaSalle et a tous ceux dans la 
compagnie. Aprés, ils le prirent et le placérent 
au milieu de la place, dansant tous autour de lui 
au son des instruments et chansons, chacun lui 
mettant sur le corps son présent qui étaient des 
peaux de boeufs qui ont de la laine comme nos 
moutons d’Europe. Si les Francais ne l’avaient 
pas déchargé a mesure de ses peaux, ils l’auraient 
étouffé sous leurs présents. II leur fit 4 son tour 
présents de haches, couteaux, et rassades. 
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ABSTRACT 


This chapter describes the first year of research on the effectiveness of automated speech recognition 
(ASR) for ESL learners in the early school years. The aim was to learn how such technology can enhance 
literacy learning as an element of L2 development, using prototype research software entitled the Read- 
ing Tutor (RT). In addition to assessing learners’ gains in reading scores, the attitudinal dimension of 
speech recognition technology was investigated in an effort to explain the effectiveness of the software. 
We found that both heritage language (L1) and level of English proficiency were linked to students’ 
reading gains with the RT. Further, the RT was shown to be equally effective to a more time-intensive 
volunteer tutoring program. A positive affective impact of the RT was demonstrated in the interview 
data but not in two widely used attitudinal scales. An Appendix describes the technical implementation 
of the project. 
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INTRODUCTION: THE LISTENING 
TO DIVERSE LEARNERS PROJECT 


Background to the Project 


Disproportionate numbers of adult Canadian im- 
migrants are reported to have poorliteracy abilities 
(Statistics Canada, 2005) and this serves as one 
indicator of their difficulty in acquiring the full 
range of skills in one of the two official languages 
of Canada, French or English, as an additional 
language. Further, home literacy practices and 
adult-child language-literacy interactions are 
widely believed by literacy researchers to affect 
children’s literacy acquisition (Kendrick, Ander- 
son, Smythe, & McKay, 2003; Purcell-Gates, Ja- 
cobson, & Degener, 2004; Reeder & Shapiro, 1997; 
Reeder, Watson, Shapiro, & Goelman, 1996). A 
steady increase in the numbers of children with 
diverse language and cultural backgrounds means 
that well over 50 percent of the school popula- 
tions in Vancouver and Toronto have languages 
other than English at home (Gunderson & Clarke, 
1998), suggesting an increasing proportion of 
young Canadian learners is at risk for difficulties 
in acquiring literacy. This is underlined by results 
of reading comprehension testing of 41,962 grade 
4 students in British Columbia which showed that 
32 percent of students, designated as learners of 
English as a Second Language (ESL), were read- 
ing at levels “below expectations” compared to 
19 percent of non-ESL students tested (Edudata 
Canada, 2002). Such statistics are worrying lit- 
eracy educators as this indicates that effective 
early reading and writing instruction is, therefore, 
necessary to establish good long term literacy 
practice in young learners (Strickland, 2002). 
One promising approach to enhancing literacy 
for ESL learners is to customize instruction by 
integrating technology into classroom teaching 
but a major limitation of most current reading 
software is its inability to “hear” readers (Casey, 
2000). Recently, research prototype software from 
Project LISTEN, Carnegie Mellon University, 
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entitled The Reading Tutor, (abbreviated to RT 
throughout) addressed this limitation by using 
automated speech recognition (ASR) to assist 
children with oral reading (Mostow, 2001; Project 
LISTEN, 2004). It listens to children read aloud 
age-graded texts displayed on screen, and offers 
to read key words or whole sentences aloud, or 
provide word meanings when children click on 
a word for help or when the program senses that 
they are experiencing difficulty as indicated by 
long pauses or non-fluent oral performance. A 
detailed description of our project’s technical 
implementation of the RT in its school settings 
appears in the Appendix. In Project LISTEN’s 
ongoing trials of the RT had been shown to be a 
promising learning technology for young native 
speakers of English. Due to the fact that the RT 
had not been assessed using young second lan- 
guage learners at the outset of the present project, 
its potential as an effective literacy intervention 
for a major population of North American urban 
children remained unknown. 

This chapter describes the first year ofresearch 
onthe effectiveness of speech recognition technol- 
ogy for ESL learners in the early school years, with 
the ultimate aim of learning how such technology 
can assist teachers in enhancing literacy learning 
as a critical element of second language develop- 
ment using the RT program as a case in point. 
The attitudinal dimension of speech recognition 
technology also was studied in aneffortto explain 
rather than merely describe the relative effective- 
ness of this type of software, and ultimately, to 
deepen our understanding of the appropriate and 
effective uses of speech recognition technology 
in early literacy teaching and learning for the 
widest possible range of children. 

The project asked four research questions: 


1. What roles do home language background 
and levels of English language proficiency 
play in determining the benefits of the RT 
for English language learners? 
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2. | What is the relative effectiveness of the RT 
approach to tutoring as compared to alter- 
native approaches to tutorial instruction in 
reading? 

3. Are there effects on attitude toward reading 
and self-concept as a reader as a result of 
use of technology such as the RT? That is, 
does speech recognition technology have 
an affective impact on English language 
learners? 

4. To what extent are the RT’s instructional 
design and reading materials consistent 
with research and best practices in literacy 
instruction and ESL education? 


The present chapter reports on our findings 
for the first three questions. Limitations of space 
prevent us from reporting on the fourth component 
of our project. 


ORGANIZATION AND OBJECTIVES 
OF THE PROJECT 


Three inter-related studies comprise the work of 
the project: 


Study 1: Home Language, English 
Language Proficiency, and Reading 
Improvement 


The first objective of this study was to determine 
the relationships amongst ESL learners’ home 
language background, language proficiency 
and reading outcomes using automated speech 
recognition as exemplified in the RT. A second 
objective was to compare the effectiveness of 
the RT with alternative approaches to reading 
instruction (Questions One and Two.) 


Study 2: Affective Factors 
Associated With the RT 


The objectives of this study were to determine 
whether use of speech recognition technology 
as exemplified by the RT had an effect on ESL 
learners’ attitudes toward reading and on their 
self-concepts as readers, respectively. A further 
objective was to develop a description of the ESL 
learners’ experience with ASR technology from 
the learner’s viewpoint. (Question Two.) 


Study 3: The Model of Curriculum 
and Instruction Underlying the RT 


The objectives of this study were to characterize 
the curricular and instructional model implicit in 
the RT by means of expert educators’ observa- 
tion and analysis and to compare that model with 
widely acknowledged best practices in second 
language literacy instruction (Question Four.) 
Limitations of space prevent us from providing a 
full report of this component of our project. Our 
teacher informants found that the RT, in its role 
as a computer-based enhancement of regular ESL 
instruction, was highly supportive of best practices 
especially when it came to enhancing learners’ 
motivation. In their opinion, it has the potential 
to be highly valuable with an ESL population if 
modifications are made. One teacher captured the 
“sense” of both the informal observation exercise 
as well as the focus group session this way: 


The RT provides a package that is not available 
to ESL students elsewhere: daily practice that is 
corrected and individual attention for a sustained 
period of time and the requirement that they 
listen to and focus on the English sound system. 
(citation?) 


Insummary, most of the teachers taking part in 
this study found the short trial in five Vancouver 
schools to have benefited their ESL learners not 
only in their reading improvement but also in 
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Table 1. Organizational plan of the project and its component studies 


YEAR ONE YEAR TWO YEAR THREE 
Study 1 Analysis and Reporting Study 1 replication 
Study 2 of Data; Study 2 replication 
Study 3 Software Redesign 


their general English improvement, and found a 
great deal in the program’s instructional design 
and content that fit their current understanding 
of “best practices in literacy instruction and ESL 
education.” At the same time, they were able to 
articulate very clearly at leastsix main areas where 
improvements to the RT’s design and content 
would be likely to enhance their students’ overall 
language learning experience. 

Each of these studies was completed in Year 
One of the three-year span of the project. A further 
aim of Year One of our project was to provide the 
RT’s design team with results that could be taken 
into account when they designed the subsequent 
version of the software. That redesign work is 
undertaken during our project’s second year, at 
the end of which, a new version of the RT would 
be made available to our research team. In Year 
Three, our Studies 1 and 2 will be replicated in 
comparable school settings. 

The chapter will provide a general overview of 
the relevant research and theoretical background 
to Studies One and Two and a description of 
the overall project design as well as setting and 
populations studied in the project. Subsequent 
sections of the chapter provide detailed methods 
and Year One’s findings, and conclude witha gen- 
eral discussion and a tentative set of conclusions 
regarding the effectiveness of the technological 
intervention for this population of L2 English 
language learners. 
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THE RESEARCH CONTEXT FOR 
THE PROJECT 


Step Zero: Pilot Study of the 
Usability of Speech Recognition 
Software and the RT by ESL learners 


Prior to assessing the benefits ofautomated speech 
recognition software in general and the RT’s bene- 
fits in particular, it was necessary to investigate the 
feasibility of using this type of program with ESL 
learners in general. Such learners are expected to 
have not just transitional English proficiency but 
also transitional phonological abilities as well as 
the accuracy of these learners’ oral reading would 
necessarily affect the recognition by the speech 
recognition software. Lau (2002) conducted a 
pilot study under Reeder’s supervision. 

All technical problems associated with install- 
ing andrunning the software and conducting video 
and audio recordings were successfully solved. 
This is significant in that the software remains 
a research prototype, and is several years away 
from commercialization in a completely “user 
friendly” format. 31 of 35 Mandarin, Cantonese, 
and Tamil speakers in grades 1-6 whose school 
reports placed them at stage 2 or above in aural 
language proficiency could interact with the RT, 
and participants’ language backgrounds did not 
appear in this small sample to affect children’s 
ability to interact with the software ata basic level. 
However, Lau’s post-instructional interviews that 
included comprehension and attitudinal probes 
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revealed potential difficulties for participants in 
areas of fluency, comprehension, and vocabulary. 
For example, although children appeared to have 
been able to read aloud most of the texts designated 
for their age level, comprehension probes revealed 
frequent failure to answer simple comprehension 
questions (who, where, when, what questions) 
about the content of what they had read. We 
hypothesized that this could have been due to 
some aspects of the RT’s instructional model or 
perhaps its limited selection of reading material 
rather than its speech recognition features. Be- 
cause these factors could not be systematically 
identified and investigated in a small scale pilot 
study, that question was identified for investiga- 
tion in the full, follow-up study. 


Affective Factors Playing a Role in 
Successful Early Reading 


Under normal circumstances, children’s attitudes 
toward reading worsen over time (McKenna, 2001) 
and doso sooner for poor readers (Walberg & Tsai, 
1985). When newreading methods are employed it 
is important to understand their affective impacts. 
The RT uses affective elements such as praise 
and emotional scaffolding to support motivation 
and self-confidence. Two studies have examined 
these aspects of the affective dimension of the 
RT. Mostow, Aist, Burkhead, Corbett, Cuneo, 
Rossbach & Tobin (2002) compared attitudes of 
178 grade 1-4 students doing Sustained Silent 
Reading onthe RT. While there were achievement 
gains for the RT group, there were some declines 
in attitude. Their attitude measure may not have 
been adequate to assess the components of atti- 
tude that could be affected by the use of the RT. 
In the other study (Aist, Kort, Reilly, Mostow, & 
Picard, 2002) persistence, an aspect of motivation 
was examined. The use of emotional scaffolding 
with the RT significantly affected persistence in 
the task, which might indicate that in the short- 
term, there was positive affective impact. If this 
finding could have been definitively attributed to 


the speech recognition elements of the program, 
suchresults would have generalizability and broad 
educational significance for reading instruction. 
However, no such work had been conducted in 
the context of ESL learners. 

Understanding the affective impact of the 
RT among a diverse population is necessary. 
Attitude and self-concept or self-efficacy were 
investigated and defined very broadly rather 
than narrowly as commonly seen in the literature 
(e.g., attitude toward leisure reading and school 
reading [McKenna & Kear, 1990] and used in 
the Mostow et al. [2002] study). This is intended 
not only in order to complement those seminal 
studies but also to deepen an explanatory account 
of findings regarding benefits for ESL children’s 
reading proficiency. 


Current Perspectives on Literacy 
Curriculum and Instruction that 
Frame our Project 


Early literacy intervention is widely promoted 
by policymakers as well as many researchers in 
order to prevent future reading and academic dif- 
ficulties (Canadian Education Association, 2004; 
Snow, Burns, & Griffin, 1998; Strickland, 2002). 
In designing interventions for reading, not only 
models of curriculum and instruction for diverse 
learners, but also characteristics of materials for 
reading instruction must be critically evaluated. 
The following findings formed part of the basis 
for evaluating the appropriateness of the next- 
generation speech recognition tutorial software 
for the young ESL learners in our project. 
Reviews of effective literacy instruction for 
diverse learners show that this is characterized 


by: 


. High expectations of success in asupportive 
environment 

° Integration of the language arts 

. Integration of skills and meaning 
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. Appropriate instruction in skills and strate- 


gies 

° Demonstrations of howreaders, writers, and 
texts work 

. Amatch of accelerating demands to students’ 
competence 


. Instructional scaffolding 

. Making reading functional and purpose- 
ful 

. Positive self-perceptions and expectations 
concerning reading 

. Use of silent reading whenever possible 

. Encouragement of learners to reflect on, 
monitor, and regulate their reading. (Au, 
1998; Braunger & Lewis, 1997; Center on 
English Learning & Achievement (CELA), 
1998; Flippo, 1997; Strickland, 2002). 


In terms of reading materials for diverse learn- 
ers, it is known that such children benefit from 
reading materials that are varied (Braunger & 
Lewis, 1997; CELA, 1998), and especially varied 
genres of high-quality children’s literature (Au, 
2002; CELA, 1998). While books whose linguistic 
structure is predictable benefit novice readers 
(McCormick & Mason, 1986), the benefits of 
phonologically contrived but semantically obscure 
(and both sociolinguistically and pragmatically 
bizarre) “decodable texts” such as “Nan can fan the 
man” for these learners remains unsupported by 
research (Allington, 1998; Weaver, 1998). Finally, 
it is known that children of diverse origins need 
texts at appropriate difficulty levels at all stages of 
progress (Au, 1998; Fountas & Pinnell, 1996). 


THE DESIGN OF THE PROJECT 


As noted above, the project consisted of three 
inter-related studies running more or less con- 
currently, the first two of which were replicated 
after a one-year hiatus for analysis and reporting 
of findings, and redesign of the software (Table 
1). Because all three studies shared a common 
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population and setting, these elements of the 
project will be described here, while detailed 
research procedures and findings will be reported 
in the two sections below devoted to Studies One 
and Two only. 


Participants 
Recruitment Process and Criteria 


On the basis of intake interview and school place- 
mentrecords forimmigrant students, we identified 
schools that appeared to enrol sizable populations 
of the three non-English home language groups 
and that were not participating in other large- 
scale district instructional projects that might 
pose logistical conflicts with our own project. We 
also excluded a small number of schools whose 
populations of ESL learners were predominantly 
composed of visiting international students. Ap- 
proximately 12 schools were identified and school 
administrators contacted with an invitation to 
consider participation. Administrators were asked 
if they believed that their schools contained (1) 
12 to 15 students in grades 2 through 6 with any 
of the three non-English home languages (2) 
who were either presently designated to receive 
ESL services or who had been so designated in 
the previous year; (3) who were identified in the 
middle ranges of ESL proficiency (this excluded 
absolute beginners in English and those learners 
completing a transition to 100 percent instruction 
in English.). 


Heritage Language Groups 


The sample of participants was constructed with 
the goal of obtaining roughly equal numbers of 
students from Hindi-Urdu', Mandarin, and Span- 
ish-speaking home language backgrounds. We 
decided to group these two languages despite the 
differences in their written scripts, in view of their 
linguistic similarity: some authorities treat the two 
as dialect variants, and others as closely-related 
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languages. The total sample contains a total of 
60 non-English speaking (ESL) learners. In ad- 
dition, 11 native English speaking students in the 
same range of grades were recruited to take part 
in the RT trial in order to provide comparison 
data. The final number of students participating 
in the program was 71. 


Control Group 


Finally, in order to provide answers to Research 
Question Two more rigorously, a group of na- 
tive English speaking children in one of our 
participating schools who were taking part in a 
new “Volunteer Reading Program” in which they 
would read with a trained community volunteer 
for about four 20-minute sessions per week for 
the duration of our study but not take part in the 
RT sessions as the control group. The distribution 
of these five groups across our five participating 
schools appears in Table 2. 


Age, Grade Levels, and Gender 


As noted, participating students ranged from 
Grades 2 through 6 in all schools andranged in age 
from 7 years 3 months to 12 years 2 months, were 
distributed across schools as shown in Table 3. 


49 boys and 32 girls took part: their gender 
distributions by home language group and school 
are displayed in Table 4. 


School Settings 


All five schools shared two common charac- 
teristics: they reflected the city’s multilingual 
and multiethnic composition, and were located 
in neighbourhoods where household incomes 
were modest to very low. One school ran both 
a breakfast and a hot lunch program with com- 
munity grant support for its children. All schools 
had well-developed learning resource and ESL 
support programs in place. Schools were set in 
a combination of mixed commercial-residential 
zoned regions through to solely residential areas, 
ranging from older to relatively newer housing 
stock and ranged in size from 252 to 771 in stu- 
dent population, using their 2003-04 enrolment 
figures. 


Teachers 


One contact teacher in each school was identi- 
fied as the primary contact person for the project 
within the school, and also was asked to be the 
contact with project staff for purposes of com- 


Table 2. Distribution of home language groups across participating schools 


School Hindi Mandarin Spanish English English Total 
Control 
Group 
B 4 0 4 7 0 15 
Cc 9 4 0 0 14 
H 1 8 5 0 0 14 
M 12 0 3 0 10 25 
O 0 4 5 4 0 13 
Total 18 21 21 11 10 81 


165 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


A Computer-Based Reading Tutor for Young Language Learners 


Table 3. Age distribution across participating schools 


School Language Mean N Minimum Maximum 
IB English 9;2 7 7;7 11;1 
Hindi 9;0 4 7;7 11;0 
Spanish 10;5 4 ES 11;6 
Total 9;5 15 75 11;6 
iC Hindi 10;9 1 10;9 10;9 
Mandarin 9:7 737 as 
Spanish 10;5 8;2 11311 
Total 9:11 14 Tey 1tsdd 
IH Hindi 10;4 1 10;4 10;4 
Mandarin 9;3 8 7;4 11;8 
Spanish 10;8 5 8;8 12;0 
Total 9;10 14 7;4 12;0 
IM. English Controls 8;4 10 733 10;6 
Hindi 936 12 7;11 11;4 
Spanish 8:6 3 7;9 9;3 
Total 8311 25 73. 11;4 
O English 835 8;0 9;0 
Mandarin 835 7;9 8;10 
Spanish 10;4 Lif 12;2 
Total 9;2 13 LT 1222 
Totals English 8;10 11 LL 11;1 
English Controls 8;4 10 733 10;6 
Hindi 9;6 18 Lif 11;4 
Mandarin 9;3 21 7;4 11;8 
Spanish 10;2 1. 735 12;2 
Total, all participants 9;5 81 73 1192). 


puter troubleshooting and any scheduling issues 
that arose. 


Dependent Measures: An Overview 
In Study One, three dependent measures were 


employed: a measure of reading proficiency; the 
Woodcock Reading Mastery Tests-Revised, with 
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the Normative Update (Woodcock, 1998); usage 
measures generated by the RT software; and a 
brief, semi-structured exit interview of students. 
Details of these measures appear below in the 
procedure section of the report of Study One. In 
Study Two, two measures of reading attitudes and 
beliefs were employed: the Elementary Reading 
Attitude Survey (ERAS) (Alexander & Engin, 
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Table 4. Gender distribution of home language groups across participating schools 


Spanish English English Total 
School Controls 

M F M F M F 
B 3 1 3 iL 4 3 10 5 
C 1 6 3 1 3 7 7 
H 1 5 3 4 1 10 4 
M 7 5 3 6 4 13 12 
O 2 2 3 2 9 4 
Total 11 7 13 8 11 10 3 6 4 49 32 


1986) and the Reading Self-Concept Scale (Chap- 
man & Tunmer, 1995.). Fuller details are provided 
in the section reporting procedures and findings 
of Study Two. 

We turn now to a detailed account of the pro- 
cedures and findings of Studies One and Two, 
followed by an account of the technical implemen- 
tation of the project in our partner schools. 


Procedures 


Study One: Home Language, English 
Language Proficiency and Reading 
Improvement 


As noted above, the first question guiding Study 
One was: 


. What roles do home language background 
and levels of English language proficiency 
play in determining the benefits of the RT 
for English language learners? 


The second question guiding this study was: 


. What is the relative effectiveness of the RT 
approach to tutoring as compared to alter- 
native approaches to tutorial instruction in 
reading? 


Design and Analysis 
Participants, Schools 


Participants and schools were 77 of the 81 origi- 
nal participants in the main project, including 14 
children from Hindi/Urdu speaking households 
(four of the original 18 children in this group left 
their schools during the study), 21 Mandarin, 21 
Spanish and 21 native English speaking children, 
11 of whom completed the RT experience, and 10 of 
whom served as a comparison group, undertaking 
daily oral reading practice with trained volunteer 
tutors in one of the project’s schools. Mean age of 
participants was 9 years 5 months, ranging from 
7:3 to 12:2 in age. We selected these L1 groups 
because they represented the fastest-growing 
non-English communities in local schools, and 
represent significant global language groups who 
are likely to be found in most large city school 
systems in North America. All children apart 
from the two native English speaker groups had 
to qualify for English Language support in current 
or immediately preceding year. Recruitment of 
participants took place as indicated in the previ- 
ous section of this chapter, where the profile of 
the five schools also is described. 
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Measures 


English proficiency levels. The school district 
used an informal, non-standardized 4-point scale 
to assess English language proficiency level for 
instructional placement and support purposes 
and specifically to qualify students for additional 
provincial ESL funding. We eliminated scale 
point 1 students, zero beginners, including only 
students on scale points 2, 3 and 4, meaning that 
all participants ranged from low intermediate to 
highintermediate English proficiency as measured 
by the schools. The psychometric characteristics 
of the scale are unknown, a concern that was 
noted for the Year 3 replication of this study 
when a standardized measure of English language 
proficiency will be employed as an independent 
measure. In the present study, however, the school 
district-developed measure of English language 
was employed as an independent variable. 

The Woodcock Reading Mastery Tests-Re- 
vised, with the Normative Update (Woodcock, 
1998) provided our dependent measures of read- 
ing, and these were administered in a pretest- 
posttest design. These are the same tests that have 
been employed by Project LISTEN. The subtests 
of the WRMT-R we employed as our dependent 
variables were: 


° Word Attack (WA). This subtest uses non- 
sense words to measure an individual’s 
ability to analyze the form and sound of 
unknown words. 

° Word Identification (WI). This is ameasure 
of sight-word vocabulary. 

° Word Comprehension (WC). This measure 
consists of three subtests: Antonyms, Syn- 
onyms, and Analogies. 

. Passage Comprehension (PC). This uses a 
cloze technique, requiring participants to 
supply words missing at fixed intervals from 
a sample prose passage. 
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Treatments 


Participants in the RT treatment group were 
scheduled for 20 minutes sessions per day for 10 
school weeks. These sessions, which were logged 
by the RT’s internal user logging systems, were 
invariably interrupted by absences, field trips 
(the study took place in the late spring months, a 
favourite time for such activities) and other school 
andnon-school activities. In addition, a20-minute 
work session did not include a full 20 minutes of 
guided oral reading, but included logging in and 
out, and various other distractions, since the RT 
host computers were located in semi-public loca- 
tions including ESL centres and quieter corners of 
school libraries. We estimate that most children 
engaged in about 15 minutes of direct interaction 
with the program per daily session. 

Participants in the volunteer tutoring group 
were seen for between 25 and 30 minutes per 
day for the same 10 week period, and worked 
with trained community volunteers in a quiet 
alcove of the large school library in one of the 
five project schools. A variety of fiction and 
non-fiction selections had been recommended by 
the school’s teacher librarian, who coordinated 
the project including volunteer recruitment and 
training. Students were encouraged to read their 
selected books aloud, and received help only if 
the reader appeared to be experiencing difficulty. 
The slightly longer treatment time of this control 
group meant that measurement of reading gains 
by the RT group would possibly be somewhat 
conservative in comparison to measurement of 
gains by the volunteer reading group, if we were 
to assume a linear relationship between quantity 
of treatment and outcome. This relationship is not 
currently known, however. 

The WRMT-R subtests were administered 
to both the RT group and the volunteer tutoring 
group at the outset of the study, and again im- 
mediately upon completion of the project. Testing 
was completed in conjunction with the measures 
of reading attitudes and reading self-concepts used 
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in Study Two, as well as aninformal exitinterview 
that was added to the post-testing routine for both 
groups. Employing raw scores for each measure, 
gain scores were computed, and the difference 
(T2-T1) scores served as our study’s outcome 
measures ina series of one-way ANCOVAs, all of 
which used age in months as a covariate in order 
to correct for potentially confounding effect of 
educational and general life experience: 


. Home language group (4) x reading outcome 
measures (4) with age in months. 

¢ English language proficiency group (4) x 
reading outcome measures (4) with age in 
months. 


A preliminary set of ANOVAs was performed 
on potential differences in means on the WRMT- 
R subtest gain scores between the 49 male and 
32 female participants by gender, and no main 
effect of gender was discovered. This allowed us 
to pool female and male participants in the main 
data analyses. 


FINDINGS AND DISCUSSION 
Home Language and Reading Gains 


Ancovas on mean gain scores for each reading 
subtest by home language groups showed robust 
main effects of time indicating that participants 
takenas a whole made significant gains onall four 
measures over the 10-week period of treatment. 
Follow up paired comparisons however revealed 
differences amongst the four L1 groups on those 
gains. Figure 1 indicates that Spanish L1 speakers 
made relatively lower mean gains on the Word 
Attack (WA) subtest than did the participants 
from Mandarin-speaking households (p=.043). 
As shown in Figure 2, our paired comparisons 
evaluation showed that Spanish L1 speakers 
also made relatively lower mean gains over the 
ten weeks of RT practice in Word Identifica- 
tion (WI) than English (p=.042) and Mandarin 
speakers (p=.030). Analysis of gain scores on 
the Word Comprehension (WC) subtest (Figure 


Figure 1. Home language group and gains in estimated marginal means in Word Attack (WA) subtest 
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3) indicated that Spanish L1 speakers made lower 
mean gains than the English NS group (p=.022) 
and the Mandarin L1 group (p=.033) respectively. 
Similarly on the Passage Comprehension (PC) 
subtest, Figure 4 shows that Spanish L1 speakers 
made lower mean gains than English (p=.015) 


and Hindi (p=.035) and Mandarin (p=.000) LI 
speakers respectively. 


English Proficiency and Reading 
Gains 


As noted above, there was a main effect of time 
on mean scores of all participants on all subtests 


Figure 2. Home language group and gains in estimated marginal means on Word Identification (WI) 
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Figure 3. Home language group and gains in estimated marginal means on Word Comprehension (WC) 
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Figure 4. Home language group and gains in estimated marginal means on Passage Comprehension 


(PC) subtest 
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of the WRMT-R (p=.000, all subtests). Paired 
comparisons of groups indicated a consistent 
advantage for the lowest of our four language 
proficiency groups. In the first comparison, for 
Word Attack (WA), Figure 5 indicates that the 
Low English proficiency group out-gained the 
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Mid proficiency group (p=.018), with no other 
between group comparisons significant. Figure 
6 depicts the paired comparisons for the Word 
Identification subtest. Here, the lowest level of 
our four English proficiency groups (Low, Mid, 
High and NS) out-gained the Mid (p=.008), High 


Figure 5. English language proficiency group and gains in estimated marginal means on Word Attack 


(WA) subtest 
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Figure 6. English language proficiency group and gains in estimated marginal means on Word Identi- 


fication (WI) subtest 
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Figure 7. English language proficiency group and gains in estimated marginal means on Word Com- 


prehension (WC) subtest 
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(p=.015) and Native Speaker (p=.004) groups 
respectively. Turning to comparisons between 
group gains on the Word Comprehension (WC) 
subtest, the low English proficiency group out- 
gained the Mid group (p=.007) and NS group 
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(p=.027) as shown in Figure 7. Finally, Figure 
8 indicates the Low English proficiency group 
out-gaining the Mid (p=.002), High (p=.021) and 
NS (p=.022) groups on the measure of Passage 
Comprehension (PC). 
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Figure 8. English language proficiency group and gains in estimated marginal means on Passage Com- 


prehension (PC) subtest 
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Summary of Findings, Question 1 


Home Language (L1) and reading gains: Spanish 
speaking children were outperformed by most 
otherhome language groups on all measures. This 
was particularly the case for the two comprehen- 
sion measures. 

English language proficiency and reading 
gains: The low English proficiency group made 
greater gains on most measures than the higher 
proficiency groups and native speakers. They 
outgained the three other groups on Word Identi- 
fication and Passage Comprehension measures. 


Question 2: Comparisons of 
Computer-Based and Human Tutoring 


The two small groups (n=11 and 10 in RT and 
Volunteer Tutor groups respectively) of native 
English-speaking participants were compared 
on the Reading outcome measures. Analyses 
of covariance of mean gains for each outcome 
measure in the WRMT-R battery revealed main 
effects of time for all measures for both groups 
(p<.05 forall subtests), indicating that both groups 
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made progress over the ten-week trial. Paired 
comparisons analyses revealed one between- 
group difference, in which the Volunteer Tutoring 
group’s mean gains were superior to those of the 
RT group (p=.007) for the Word Comprehension 
subtest. The two groups did not differ in theirmean 
gains on the Word Identification, Word Attack or 
Passage Comprehension subtests. 


GENERAL DISCUSSION 


The results of the analyses of both the home lan- 
guage group and the English language proficiency 
data suggest two general patterns. First, home lan- 
guage (L1) group did appear to figure in the gains 
enjoyed by all participants using the RT. Children 
from Spanish-speaking households, while making 
respectable gains over the 10-week trial, were 
outperformed by children from Hindi/Urdu, 
Mandarin, and English-speaking households. 
Anecdotal evidence obtained from the schools 
suggested that this finding was consistent with 
school performance for these children. Further, 
that anecdotal evidence also suggested that this 
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group of second language learners contained a 
disproportionate number of children of refugee 
families who entered Canada either directly from 
Central America or indirectly via Mexico. This 
observation has just been recently borne out by 
a large-scale independent study of immigrant 
learners in this district (Gunderson, 2006). 

The second pattern evident in the findings for 
Question | is that English language proficiency 
level also played a role in the gains enjoyed by 
all participants using the RT. This finding is 
tempered somewhat by the rather common-sense 
notion that, of the four language levels involved 
in the study, it follows that the lowest level of 
English language learners stood to gain the most 
from any sort of language intervention, all other 
things being equal. The finding also was in accord 
with teachers who also observe relatively steep 
language learning curves for most beginning 
English language learners. 

The results flowing from our investigation 
of Question 4 concerning relative efficacy of 
the RT when compared to a volunteer human 
tutoring program should be treated with some 
caution, for several reasons. First, the “Listen- 
ing to Diverse Learners” project worked with 
intact educational groups in everyday schools, 
and as a result it showed design characteristics 
of “quasi-experimental” studies rather than true 
experiments in which participants are assigned to 
treatment conditions on arandomized basis. This 
option was not available to the researchers, and 
thus the conditions under which the 10 students 
were recruited to the volunteer tutoring program 
were not under our control, nor were the criteria 
rigorously documented. Further, the two groups 
of native English speakers involved in this ele- 
ment of our study were the smallest in size of the 
participating groups. A larger-scale study, ideally 
using random assignment to conditions would be 
the only way to adjudicate the matter of efficacy of 
tutoring options. For a good example of research 
that compares alternative reading interventions 
with the RT on an equal-time, controlled basis, 
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see Mostow et al. (2002). For these reasons, this 
particular finding should be treated as suggestive 
only. Another way of viewing this findings is that 
for all measures but Word Comprehension, the 
RT treatment “held its own” in terms of reading 
gains against what was a slightly more intensive 
human tutoring program (25 to 30 minutes per 
day, compared to the RT’s 15-20 minutes per 
day.) If borne out, this type of finding would 
have interesting policy implications at the level 
of cost-efficiency in areas such as staff training 
and overall cost of an intervention, and speaks to 
those teachers who longed for the opportunity to 
work individually for 15 or 20 minutes a day with 
each of their students and were prevented from 
doing so by the vicissitudes of routine scheduling 
and workload. 

We turn now to our study of the affective 
factors that might underlie gains in reading per- 
formance both in the shorter term as observed 
in our project, or longer term, as observed in the 
lives of linguistically-proficient citizens. 


STUDY TWO: AFFECTIVE FACTORS 
ASSOCIATED WITH THE READING 
TUTOR 


Design and Analysis 


We employed two main approaches to addressing 
Question Two, which as noted above was framed 
inthe following ways: Are there effects on attitude 
toward reading and self-concept as a reader as a 
result of use of technology such as the RT? That 
is, does speech recognition technology have an 
affective impact on English language learners? 
We administered two scales both prior and im- 
mediately following the RT experience, each of 
which tapped a different affective element. In 
addition, on conclusion of the 10-week RT trial, 
we administered a short interview that attempted 
to tap the young readers’ affective response to 
their experience of the RT. 
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Instruments, Exit Interviews, Procedure 
Attitudes Toward Reading 


To capture this dimension, we employed the El- 
ementary Reading Attitude Survey or “ERAS” 
(McKenna & Kear, 1990). This survey is a 20- 
item, four-node pictorial rating scale that uses a 
cartoon character popularized in the USA and 
Canada inthe 1980s, the cat “Garfield.” The survey 
consists of two 10-item subscales: These focus on 
recreational reading and academic (school-related) 
reading attitudes respectively. Internal reliability 
as indicated by Cronbach’s alpha was .82 and .83 
respectively. The instrument was normed on a 
U.S. population, and has been used in numerous 
studies and, of particular interest to our team, 
with Reading Tutor studies by Project LISTEN, 
Carnegie Mellon University. 

Preliminary trials of the scale’s actual il- 
lustrations with a sub-sample of children raised 
a serious technical problem that could perhaps 
only have been detected with a multilingual, 
multicultural population. For our trial students, 
the character no longer appeared to enjoy popu- 
lar currency, and, possibly for cultural reasons, 
did not engage our participants’ interest. Some 
younger children found the character somewhat 
frightening or angry-looking on one end of the 
scale. For that reason, we adapted the scale by 
creating a set of what we hoped would be more 


generally acceptable “happy-face” emoticons, as 
shown in Figure 9. 

Sample items for the adapted ERAS in- 
cluded: 


“How do you feel about taking a reading test?” 


“How do you feel about reading for fun at 
home?” 


Participants simply were asked to point to the 
scale point which best described their response 
to a survey item. 


Concept of Self as Reader 


The second scale we employed was designed to 
tap the second element of the question guiding 
Study Two, students’ concepts of themselves as 
young readers. We employed the Reading Self- 
Concept Scale (Chapman & Tunmer, 1995). Thisis 
a 30-item measure with items scored on a Likert- 
type scale ranging from 1 (No: Never) through 
3 (Not sure) to 5 (Yes: Always) in degree. The 
scale employs three 10-item subscales, consisting 
of items dealing with Difficulty, Competence, 
and Attitude. The survey’s internal reliability is 
reported as .85 for the total measure, and it was 
normed on a New Zealand population where it 
had been developed. Typical items for each of the 
three subscales are as follows: 


Figure 9. Adapted scale illustration for the ERAS instrument (Illustration by Jay Handel) 
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. Difficulty: If you can’t say a word do you 
get someone to help you? 

. Competence: Is work in reading easy for 
you? 

* Attitude: Do you like reading at home? 


Scale items are read aloud to participants, and 
oral responses are recorded and scored. 

Scale scores were compared, pre- and post- RT 
trial, and mean differences were computed for 
a series of analyses of variance designed to test 
hypotheses aboutthe relationships between home 
language (L1) group and English language profi- 
ciency level on the one hand, and reading attitudes 
and concepts of self as reader on the other._ 


Interview: Participants’ Experience of 
the Reading Tutor 


This consisted of a semi-structured interview 
administered by two language education specialist 
members of the research team, and consisted of 
the following questions: 


What did you like or dislike about your work on 
the Reading Tutor? What do you think should be 
changed by its designers? 


The second of these two questions was de- 
signed to elicit student information of interest 
to Study Three’s goals as well. The interview- 
ers employed encouraging prompts and probes 
whenever participants appeared reluctant to offer 
candid observations. 


FINDINGS AND DISCUSSION 
Attitude and Self-Concept Scales 

On analyses of variance comparing mean gain 
scores for both the ERAS and the Reading Self- 


Concept Scale, there were no main effects of time 
either for Home Language groups or for English 
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language proficiency groups. Similarly, paired 
comparisons between Home language groups 
and between English language proficiency groups 
indicated no relationships with either ERAS 
changes or Reading Self-Concept Scale scores 
over the 10-week trial. 

By way of interpreting these findings, it can 
be argued that paper and pencil measures such as 
ERAS and the Reading Self-Concept Scale have 
relatively high internal reliability and test-retest 
reliability, but comparatively less construct valid- 
ity. Attitudes and self-concept are internalized, 
learned predispositions and perceptions that have 
developed over long periods of time, and thus are 
likely to be influenced by many factors in addition 
to achievement. Brief interventions as exempli- 
fied by Study One’s 10-week trial, no matter how 
successful at raising performance on achievement 
measures, probably will have relatively less im- 
pact on those slow-growing dimensions of affect. 
We return to the question of longer-term literacy 
interventions in the concluding remarks to this 
study, below. 


Interview Findings on Participants’ 
Experience of the Reading Tutor 


The authors conducted an informal content 
analysis using keywords and concepts found in 
participants’ responses to the semi-structured 
interview questions, and discerned at least three 
coherent themes, which we summarize here: gen- 
eral impressions of the RT experience; technical 
aspects of reading including word attack, word 
recognition, and vocabulary; and finally, reading 
comprehension. Interestingly, these were themes 
that the teachers participating in our Study Three 
(below) also discussed at length. 

General impressions of the RT experience. 
Typical responses in this area are illustrated by 
speakers of all four home languages, across all 
language proficiency levels and across genders. 
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Spanish L1 speakers noted: 


The computer was fun. (Intermediate grade 


I like it because they teach me to read more. 
It was fun. (Primary grade boy, Low English 
proficiency) 

It was fun. (Intermediate grade girl, Low 
English proficiency) 

They should have a harder level for older 
kids. (Intermediate grade girl, High English 
proficiency) 

We need the RT to read harder books not 
just easy books — like chapter books not just 
picture books. (Primary grade girl, High 
English Proficiency) 


A range of Mandarin L1 speakers told us: 


It was a happy time. There were a lot of 
stories. I liked them all. (Intermediate grade 
boy, Low English proficiency) 

I get to choose the stories I want and I get 
to create stories. (Primary grade boy, Low 
English proficiency) 

I like to type the story because it is fun and 
my Mom says if you learn to type a story 
you can maybe be an author. (Primary grade 
girl, Low English proficiency). 

I like the RT but when in class I’m doing 
something really good and when have to go 
to RT, I don’t feel good about it. (Intermedi- 
ate grade boy, Mid English proficiency) 


Their Hindi/Urdu L1 counterparts reported: 


I like to read the stories and type the words. 
(Intermediate grade girl, Low English pro- 
ficiency) 

It’s fun reading. (Primary grade girl, Mid 
English proficiency) 

I didn’t like when I said a word and it didn’t 
understand it. (Intermediate grade boy, Low 
English proficiency) 


girl, High English proficiency) 


while several English L1 speakers had this to 
say: 


. I got to pick my own stories. (Intermediate 
grade boy, Native English proficiency) 

° Iliked it because there’s lots of good stories. 
(Intermediate grade girl, Native English 
proficiency) 

. In the starting I liked it because it was new 
and I don’t usually get to use the computer. 
But then I got used to it and got bored. 
(Primary grade boy, Native English profi- 
ciency) 

. Itused to be hard toread out loud but now it’s 
easier. It gave me confidence. (Intermediate 
grade boy, Native English proficiency). 


Word attack, word recognition, and vocabu- 
lary; again, observations in these technical areas of 
reading were distributed widely across L1 group, 
English proficiency levels, and genders. Spanish 
L1 speakers noted: 


. I read a story and when I was stuck and 
if I can’t sound it out, it would tell me the 
word. (Primary grade boy, Low English 
proficiency) 

. I learned new words and pronunciation. 
(Intermediate grade girl, Low English pro- 
ficiency) 

. Before I didn’t really understand the hard 
words but now I understand them more. 
(Intermediate grade girl, Mid English pro- 
ficiency). 


Their Mandarin L1 counterparts observed: 
. Ilearned how to pronounce words. (Interme- 
diate grade girl, Low English proficiency) 


° I can learn words fast and sound it out. By 
listening to the RT, I can hear it and then I 


177 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


A Computer-Based Reading Tutor for Young Language Learners 


know. (Intermediate grade boy, Low English 
proficiency) 

° It helped me learn a new word, “evergreen.” 
Itmeans that trees will be green forever. (Pri- 
mary grade boy, Low English proficiency) 

. It helped me when I read something wrong, 
it corrects me. (Primary grade girl, Mid 
English proficiency). 


Hindi L1 participants added the following ob- 
servations: 


° When I clicked on words I would want to 
know the word but it says like the vowels, 
not the whole word. (Primary grade girl, 
Mid English proficiency) 

. Ithelped me read hard words. When I needed 
help the computer would help me. (Primary 
grade girl, Mid English proficiency). 

. The way it sounded out words helped me 
learn to read them. (Intermediate grade boy, 
High English proficiency). 


The native English speaking children assigned 
to the RT contributed these remarks about this 
theme: 


° It helped me by saying word I didn’t know 
how to read. (Intermediate grade girl, Native 
English proficiency) 

° There’s lots of hard words and it helps you 
sound it out and if you can’t sound it out, 
you just click on the word and it tells you. 
(Intermediate grade girl, Native English 
proficiency) 

. It helped me learn to read by sounding 
words. (Primary grade boy, Native English 
proficiency). 


Reading comprehension: as before, responses 
emerged from all language groups, English pro- 
ficiency levels, and genders. Spanish L1 children 
for example offered these responses on the theme 
of comprehension: 
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. Iliked the stories and especially the informa- 
tion stories. (Intermediate grade boy, Mid 
English proficiency) 

° Before I didn’t like to read, now I do because 
when you first start a book you get excited 
about what’s going to happen. (Primary 
grade girl, Mid English proficiency) 

. The RT helps you start reading and under- 
stand the books more. (Intermediate grade 
girl, Mid English proficiency). 


Several Mandarin L1 speakers also had the fol- 
lowing to say about this theme: 


° It helped me learn about many things. (Pri- 
mary grade girl, Low English proficiency) 

° I learned how they made the guitar or how 
they started without cars. (Primary grade 
boy, Mid English proficiency) 

. There was stuff I didn’t know and I learned 
the stuff I didn’t know. (Primary grade boy, 
Mid English proficiency) 

. Ilearneda lot of words and stories. (Primary 
grade girl, Mid English proficiency). 


Hindi L1 speakers offered these observations 
about the writing component of the RT as well as 
some additional payoffs of the reading content: 


° I really enjoyed how you create your own 
stories and stuff. The books that were really 
hard for me are getting easier. (Intermediate 
grade boy, High English proficiency) 

. It did help me in class. Once it set up a story 
and that helped mein thenextscience lesson. 
Then the whole science was easy. (Interme- 
diate grade boy, High English proficiency) 


A further observation from one of the Hindi 
L1 speaker seems to get to the heart of why such 
interviews seem to tap attitudes and personal 
response to literacy experience so effectively: 
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° I felt inside that I learned about these books. 
(Primary grade boy, High English profi- 
ciency) 


Finally, one native English speaking child 
touched on reading and the growth of world 
knowledge in his own fashion: 


. It teached me different things. (Primary 
grade boy) 


Discussion 


In summary, it appeared from the broad distri- 
bution of the interview responses that students 
from all language groups and English proficiency 
levels enjoyed the Reading Tutor experience. 
This appeared to be due principally to the as- 
sistance provided, the relative independence it 
offered them, and for some, the sheer novelty of 
the experience. 

Students in all language groups and English 
proficiency levels responded most favourably to 
the assistance the RT provided in word recogni- 
tion in particular. They appreciated the fact that 
this component of the RT facilitated their reading 
fluency, comprehension and enjoyment of the 
stories. In addition, many students enjoyed the 
opportunity to write their own stories. Several 
noted the transfer of the RT experience to other 
school work. 

A general observation of this data indicates 
that the RT had favourable affective impacts on 
the students. It suggests that over a longer period 
of time, along with increased proficiency, more 
positive attitudes toward reading and perceptions 
of self as a reader might develop. In our Year 3 
replication of this study, we plan to run a longer 
trial, and will develop the brief post-RT interview 
into a pre- and post-trial interview containing ad- 
ditional items designed to capture a wider variety 
of components of attitude and self-conceptrelated 
to children’s literacy development. 


GENERAL DISCUSSION: TRENDS 
FOR RESEARCH AND 
DEVELOPMENT IN 
COMPUTER-ENHANCED L2 
READING SUPPORT 


Taken together, the two studies reported here that 
comprised part of the work of the first year of the 
“Listening to Diverse Learners” project provide 
complementary approaches to the general problem 
of assessing the effectiveness of using advanced 
speech recognition technologies to support the 
literacy development of young English language 
learners. 

Study One offered evidence that home lan- 
guage can play a role in determining the effec- 
tiveness of an implementation of ASR such as 
the Reading Tutor for young immigrant learners. 
However, amore careful ethnographic analysis of 
specific populations of language learners would 
be needed before we accepted L1 as a determi- 
nant of success, and specifically, whether there 
are other, non-linguistic factors such as refugee 
status and interrupted educational history that 
are interwoven with heritage language group 
membership. Only then can we be more certain 
that we are assessing this aspect of our research 
question in a valid manner. Further, it appears 
that level of English language proficiency is a 
variable in determining the amount of progress 
that learners will make, and this finding is in ac- 
cord with educational observations about growth 
trajectories in second language learning in gen- 
eral. Hence, the fact that more advanced level 
English learners made relatively slower progress 
in reading in our trials should not be viewed with 
alarm, but as an indicator of a widely-distributed 
pattern of language growth. Third, our finding 
of few differences between the RT and a human 
tutoring counterpart in terms of reading growth 
needed to be treated with some caution because of 
limitations in the design of a quasi-experimental 
study and sample size. Nonetheless, we noted that 
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a much less intensive treatment in the RT condi- 
tion yielded equal results to the more time and 
human labor-intensive human tutoring condition, 
suggesting that ASR is a promising and cost-ef- 
fective language learning innovation to pursue. 
And these cautions aside, it remained the case 
that all groups of learners regardless of how they 
were defined made significant, measurable reading 
gains during the short trial on the RT. 

Study Two provided insights into the limita- 
tions of paper and pencil assessments of the af- 
fective dimension of reading, and demonstrated 
equally the merits of employing clinical interview 
methods to tap this critical element of reading 
growth and long term dispositions toward literacy. 
Findings of this study pointed to the need also for 
longer term trials in order to determine whether 
the very positive affective response found in the 
student interviews was short-lived or longer term 
in nature, and whether it could provide evidence 
of growth and change of this dimension of reading 
and literacy in general. 


Trends in the Use of Automated 
Speech Recognition for 
Second-Language Literacy 
Instruction 


The authors and their research team can offer 
several directions for further investigation of 
this area of applied linguistic and educational 
research. The first element of the use of ASR 
technologies for L2 learners concerns the suc- 
cessful integration of opportunities for writing. 
Users and teachers alike told us that the RT did 
an excellent job in hearing even novice second 
language learners’ speech production despite the 
massive technical challenge posed by doing so in 
plausible and workable ways. Could productive 
output language on the writing side of the ledger 
be promoted in prominence in order to capture 
the benefits both linguistic and motivational of 
learners being able to practice writing for its 
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own sake? Learners could then link what they 
have written to an interesting design feature of 
the RT that incorporates student-written stories 
into the available material for others to read 
within the program. Readers/writers have in 
effect “customized” the program in accord with 
their own interests. 

A second direction for computer-enhanced 
literacy support for second language learners 
deals with the technology’s ability to allow the 
creation of reading content that is of interest to 
specific ethno-cultural communities of learners. 
A challenge we contemplated at one point in our 
work with the RT for instance was whether the 
rich vein of First Nations stories so well known 
to young aboriginal learners in the Pacific North- 
west region of North America could be adapted 
for use in the RT. At one level this is a trivial 
technical problem. At another level, the question 
of research, selection and implementation of such 
culturally-attuned material requires considerable 
educational and social sensitivity and wisdom. 
As a result of Study One’s results in the present 
project, the authors also have been challenged 
to think seriously about what sort of computer- 
enhanced reading support tools would truly be 
effective forthe children of refugee families, one of 
whom, in our own project’s case, faced imminent 
deportation, and most of whom had experienced 
serious disruptions in their educational histories, 
as did their parents. 

A third and equally challenging research and 
development problem has to do with evaluating 
whether the interactive behaviour of a program 
suchas the RT is attuned to a culture’s expectations 
for communicative competence. Are wait times 
too short? Do help prompts seem too intrusive 
or too benign? Is the pace of instruction about 
right? For both sorts of cultural adaptations, an 
interdisciplinary project would be required in 
which engineers work alongside educators and 
applied linguists, and development proceeds by 
means of short and recursive cycles of engineer- 
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ing design and instructional design, rather than 
by means of lockstep design stages. 

A fourth direction we suggest in this area 
of research and development is addressing the 
question of scalability of successful technology 
designed for younger L2 readers out to a wider 
audience developmentally. Could content be devel- 
oped that suits youth and young adult L2 readers, 
given that this category is widely used to market 
fiction? Could content be developed that meets the 
particular needs of adult L2 learners, perhaps at 
varied levels of educational background ranging 
from Adult Basic Education levels through to 
English for Academic Purposes (EAP)? This is 
turn would require modifications to the look of 
a program’s user interface in order to make the 
experience appealing. Ourteam is beginning work 
with the Project LISTEN team to learn how to 
adapt the sophisticated content structure of the 
RT for youth and young adult readers. As with 
cultural scalability work, we hope to proceed with 
simultaneous instructional and engineering design 
in a true multidisciplinary approach. 
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KEY TERMS 


Affective Dimension, Affective Domain: 
Part of the most widely cited taxonomy of edu- 


cational objectives, the affective domain differs 
from the cognitive domain in learning in that it 
emphasises feelings and attitudes toward learning 
and toward the content of learning. 


Analysis of Variance (ANOVA), Analysis 
of Covariance (ANCOVA): ANOVA is one of 
the more powerful statistical methods of testing 
differences amongst two or more groups’ mean 
scores against chance. Its power derives mainly 
from the fact that it takes into account each case’s 
contribution to a group’s mean score. An AN- 
COVA has the added possibility of including a 
correction across differing groups for a poten- 
tially-confounding variable, thereby controlling 
that variable’s impact upon a group difference of 
interest to the researcher. 


Automated Speech Recognition (ASR): A 
branch of natural language processing in computer 
science, ASR uses speech processing software to 
recognize words andinsome applications, speech 
sounds in a speaker’s spoken input. The Reading 
Tutor’ ASR function is based upon Carnegie Mel- 
lon University’s open-source Sphinx-II speech 
analyzer, which uses the well-known probabilistic 
“Hidden Markov Model” approach to interpreting 
spoken input. 


Heritage Language: The language that was 
principally used by an immigrant community prior 
to their migration to a new linguistic community. 
Heritage languages are often maintained by vital 
immigrant communities, and can be promoted 
by enlightened language policies as a way of 
enhancing the multilingual nature and cultural 
diversity of a community. 


Language Proficiency: A measure of level of 
mastery of a target language by learners. Mastery 
is often defined in terms of a fairly complex set 
of skills entailed in communicative competence, 
and hence can involve more than accuracy of 
pronunciation, vocabulary or grammar. 
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Reading Comprehension: A reader’s retrieval 
of an author’s meaning intentions from a written 
text. The tests used to assess reading comprehen- 
sion in the present studies (WRMT-R) evaluate a 
reader’s understanding of meanings of individual 
words (“word comprehension”) and of longer pas- 
sages of text (“passage comprehension.”) 


Scaffolding of Learning, Emotional Scaf- 
folding: First used by the cognitive psychologist 
Jerome Bruner, scaffolding of learning refers to 
the ways in which adults hold aspects of an envi- 
ronment constant, allowing a learner to focus on 
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the element of learning which is being acquired. 
Such scaffolding can be gradually withdrawn, 
allowing a learner to operate independently. A 
frequently-used example is the way in which 
some story books for children will follow a fixed 
syntactic pattern from page to page and introduce 
only one word or phrase on each succeeding 
page. The term “emotional scaffolding” is used 
in Project Listen’s Reading Tutor research in a 
more general sense to refer to the user interface’s 
provision of emotional support such as praise and 
encouragement to users during interactions with 
the program. 
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APPENDIX 
Technical Implementation of the Project 
Prepared by Reg D’Silva, The University of British Columbia 


The Reading Tutor (RT) is a software tool that “displays stories on a computer screen and listens to 
children read aloud” (Project LISTEN, 2004).The software, built with Carnegie Mellon’s “Sphinx- IT” 
automated speech recognition engine, analyzes children’s oral input and provides them with assistance 
during reading (ibid). This Appendix first describes the different possible configurations of the RT, 
then explains the project set-up that was employed for the use of the RT in Year One of the Listening to 
Diverse Learners project in Vancouver schools, and concludes with a brief description of the physical 
layout of the equipment in the schools. 


Reading Tutor Configurations 


The version of the RT program supplied by Carnegie Mellon University (CMU) for Year One of the 
project was designed in a “Client - Server” architecture (see below) and was recommended to work 
best in a Microsoft Windows 2000 Operating System (OS). This version mainly consists of two parts 
namely the “Client” and the “Server”. The client is the interactive part of the RT program. This is where 
the student logs in and is presented with stories. The Server part of the program includes the database 
and a set of routines that enables the transfer of data files to CMU. The server part of the program thus 
stores data that can be uploaded to another server. “Client-Server” architecture is typically “a networked 
information processing architecture in which information and programs are stored on both servers and 
clients, and processed cooperatively as the client processor interacts with the server. Tasks may be local, 
shared, or centralized” (Commnett, 2004). It is possible for the client part of a program to reside on the 
same machine as a server or on another remote machine. 

An RT host, which is a computer that has the RT software installed on it, could be configured to 
have one of the following modes, using terms provided by Project LISTEN, CMU: 


1. “Amnesiac” mode where the RT program does not retain any user or usage data. An Amnesiac 
host has solely the client part of the RT program installed. It is not configured to have a server 
connection. This mode was used mainly for demos and trials of the RT software. 

2. “Remote Client” mode also is where only the client part of the RT program is installed. It is however 
configured to have a server connection. This mode may be used for hosts in a classroom where 
there is a need to have multiple stations running the RT program. 

3. “Server” mode where the host is installed with only the server part of the RT program and the 
scheduled tasks or routines to upload information i.e. data files, to CMU. Hosts using RT in this 
mode could be used as the “Site Server” for remote client hosts as described above. 

4. ART host also can be configured in the “Networked Client-Server” mode where the host is com- 
plete with the client, the server and scheduled tasks or routines to upload data files to CMU. Hosts 
using RT in this mode could be used as a client while also functioning as a “Site Server.” It also 
could be used as a solitary machine that acts as a networked client and server. This means such 
a host could run the RT program and collect data. The locally stored also can be automatically 
uploaded. 
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5. “Standalone” mode where the host is configured to have both client and server parts of the RT but 
is not networked. Data would need to be manually transferred between such hosts and the CMU 
server. This mode exists where the RT host is installed complete with the client, server and data- 
base part of the RT program and network ready but is not connected to a network only because of 
unavailability of suitable networking infrastructure. 


The implementation at the UBC RT project used the Standalone mode of RT hosts. This term was 
used to describe such hosts because they were equipped with both the client and server programs but 
they were not connected to a network due to unavailability of suitable networking infrastructure. Figure 
10 illustrates the Standalone RT host. 

The dotted line illustrates the extent of the “Standalone” host. This was the type of implementation 
that was used for RT hosts in the RT project at UBC. It is installed with both the client and server part 
of the RT software along with the set of routines to upload data files but is not connected to the network 
and therefore is not able to communicate with the server at CMU. Upload of data files to CMU had to 
be done manually and this process is described in the next section. 


Project Set-Up 


The RT host functioning in the “Standalone” mode is designed to collect and store data files locally in 
a MySQL relational database management system. In this mode, a user logs into the RT program and 
reads a lesson. The program stores the data files generated during this session locally in the database in 
the hard disk of the computer. These data files are then manually harvested and transferred to another 
machine that is networked to the CMU server. The data files can then be uploaded to the CMU server 
from this machine through software routines. The uploaded data files are then processed by CMU and 
data is available for viewing through a Web-browser at the “Project Listen Teacher Website.” 
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It was assessed that the schools taking part in the project in Vancouver might not have the infrastruc- 
ture to support high-speed networking and, therefore, the project was set up to work with Standalone 
RT hosts in schools. As a result, the steps that were carried out in collecting and transferring data were 
partly manual and partly automated. The process is described below and illustrated in Figure 11. There 
were five schools participating in the Year One of the project and one standalone RT host was made 
available at each school. The RT program was installed under the Windows 2000 Operating System. 


Step 1 


The data files that were generated from using the RT in the schools were harvested on to a CD by the 
project research staff. This process was carried out twice a week in each participating school. 


Step 2 


The data-CDs were carried to the research office at UBC by the project staff. The data files from these 
CDs were manually transferred to designated file folders on the hard disk of a computer (Main RT 


Host-UBC). 


Figure 11. 
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Step 3 


The main RT Host in the research office was configured to run software routines that would transfer 
data files from these designated folders to CMU. This operation also was carried out twice a week. 


Step 4 


The data was then processed by CMU and could be viewed on the Web at the “Project Listen Teacher 
Website”. This is a restricted access Web site that allows teachers and research staff to login and view 
the progress of the participants. Figure 11 illustrates the steps described above. 


Placement, Location and Layout of Hosts 


Five RT “Standalone” hosts, one per school, were deployed in the local school system where the project 
is located. One main or Central “Networked Client and Server” computer, used to transfer data files 
from the five RT hosts, was commissioned and located in the project’s research office at UBC. The RT 
hosts were placed in the ESL resource rooms in the case of B, M and H schools, while the host was 
located in the library in C school. O school placed the RT host in a bright workroom accessible through 
the library. The hosts were located in a carrel or on a table. The typical layout of a host, as on a table, 
is shown in the photo in Figure 12. 


Figure 12. 
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ABSTRACT 


In this chapter an instructional format, Peer-Based Intervention (PBI) using computer keystroke logging 
is investigated as a computer technology to enhance language acquisition. In PBI, a process-oriented 
approach is taken, in which noticing, reflection and language awareness are central concepts of language 
learning. The method aims to promote learning through individualized reflection and social interaction. 
A retrospective focus on the evolution of a foreign language text is used as a basis for reflection and 
discussion. This period of reflection and discussion opens up paths for both individual and peer-based 
noticing and learning. 


INTRODUCTION students and as writers, learn what works well 

for them and develop strategies for addressing 
Trupp (2005) wrote that reflective learners fo- or overcoming the parts of writing or analyzing 
cus on their patterns, habits and preferences as literature that frustrate or puzzle them. Learning 
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to learn, akey skill of life-long learning, lies atthe 
core of the reflective learner who is someone who 
explores their experiences of learning to better 
understand how they learn witha view ultimately 
to improve their further learning. The reflective 
learner generally is self-aware and self-critical; 
honest about themselves, and open to criticism 
and feedback. He or she is also objective in 
weighing up evidence; open to and prepared to 
try different approaches; curious to discover other 
approaches; motivated to improve and more able 
to carry through independent learning. These are 
skills and attitude that are helpful when learning 
a second or foreign language. 

In this chapter we consider a new computer- 
based learning method that assists reflective 
learning in those who are and those who are not 
natural reflective language learners. The method 
is based around Computer Keystroke Logging 
which is an exciting development in writing 
research methodology that allows a document’s 
evolution to be logged and then replayed as if the 
document was being written for the first time (see 
Sullivan & Lindgren, 2006). Computer keystroke 
logging software, such as JEdit (Cederlund & 
Severinson Eklundh, n.d.), ScriptLog (Stromqvist 
& Malmsten, 1998), and InputLog (Leijten & 
Van Waes, 2004), allows the revisions and pauses 
made by authors during the writing of texts to 
be analyzed. This kind of software thus affords 
more than the ability to replay a sequence of re- 
corded keystrokes. Researchers, such as Kollberg 
(1998) and Ransdell, (1990) who have used and/or 
developed computer keystroke logging software 
programs, have pointed at the potential advantages 
of using keystroke logging as an awareness-rais- 
ing and reflection-promoting learning tool. The 
replay function and the log files can be used as 
tools to reflect on writing processes and may 
“provide insight for the composition instructors 
and students” (Ransdell, 1990, p. 143). Sullivan, 
Kollberg, and Palson (1998) used keystroke log- 
ging to study the composition processes of young 
EFL writers and suggest that the methodology 
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can assist L2 teachers by providing information 
about students’ “areas of insecurity and security” 
(p. 22). Thus, it has been claimed and shown 
that the use of computer keystroke logging can 
result in teaching that is better targeted towards 
individual students. 

This chapter presents and describes com- 
puter keystroke logging with the objective of 
demonstrating how it can effectively be used to 
support reflective learning. The chapter begins 
by giving the reader the necessary background 
in computer keystroke logging and how aware- 
ness can be enhanced through reflection before 
turning to the core focus of the chapter, which 
is to demonstrate how a novel computer-based 
learning approach, known as “Peer-Based In- 
tervention using computer keystroke logging,” 
can successfully be used to support reflective 
language learning. The pedagogical applications 
are demonstrated through data from a research 
study that has used keystroke logging in a Swed- 
ish High school English as a Foreign Language 
(EFL) classroom to promote individualization of 
learning and the development of reflection as an 
approach to encourage the development of life- 
long reflective learning. 


COMPUTER KEYSTROKE LOGGING 


Computer keystroke logging provides informa- 
tion about writers’ online cognitive processes by 
recording and analyzing the step-by-step creation 
of computer-written texts. Keystroke-logging 
software accurately records every keystroke and 
keyboard action that a writer produces including 
the exact moment of occurrence of a keystroke 
and the duration between keystrokes. The data is 
stored in a log file and analyses can be generated 
that provide detailed information about aspects 
such as the length and distribution of pauses that 
a writer makes during writing and the changes he 
or she makes to the text. This information provides 
an indirect means of observing and analyzing 
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writing processes such as planning and revising. 
However, in order to gain information about the 
content of a revision or the effect it has on the 
text, manual analysis is necessary. 

As long as subjects are familiar with the com- 
puter as a writing medium, keystroke logging 
offers a natural writing environment in which 
writers can work with theirtexts without intrusion 
or disturbance (Lindgren, 2005). From a writer’s 
point of view, most computer keystroke logging 
programs appear as a word processor that allows 
the writer to work with their text as they normally 
would on a computer. 

It is possible to supplement keystroke-logging 
data with additional data collection methods such 
as think aloud protocols. Writers can be asked 
to voice their thoughts while writing a text (i.e., 
concurrent protocol) or to retrospectively reflect 
on their text creation process (i.e., retrospective 
protocol). Retrospective reflection is possible 
because keystroke-logging programs include a 
replay function with which the step-by-step cre- 
ation of the text can be played back to the writer. 
Retrospective protocols have the advantage of 
being non-intrusive. 


ENHANCING AWARENESS 
THROUGH REFLECTION 


One of the first steps a learner takes towards 
language awareness is noticing features in the 
input that have not, up to that point, been salient 
(Schmidt, 1990; Truscott, 1998). Once a feature 
has been noticed it becomes available for reflection 
and analysis. In order for noticing to occur the 
learner has to be provided with suitable material, 
methods and learning environments. It is here 
that computer keystroke logging can support the 
reflective language learner and develop reflective 
skills in all learners. 

Noticing of features in the input is more likely 
to occur if they are made salient to the learner. 
However, if the input is at a level for which the 


learner is not yet cognitively ready, noticing is not 
likely to occur evenif itis made salient. Appropri- 
ate input comes from the level above the learner’s 
present level (e.g., “readiness,” Pienemann, 1998; 
“zone of proximal development,” Vygotsky, 1978). 
One way of providing students with appropriate 
input is to make use of their own output, for ex- 
ample, when unclear issues in the student’s own 
output are noticed and discussed. In writing, for 
example, revisions made during atext’s production 
provide hints about the language learners’ skill 
level. If a learner revises agreement incorrectly, 
the revision could indicate that the learner has 
noticed agreement but has not yet mastered this 
grammatical feature. This feature could come 
from the skill level above the one the learner is 
currently working with and the identification of 
an error involving this feature could indicate that 
the learner is ready to move to the next level and 
learn how grammatical agreement functions. 

Roca De Larios, Murphy, and Marin (2002) 
found that, in general, writers use similar revi- 
sion strategies when writing in their first (L1) and 
second languages (L2). However, in spite of the 
similarities in revision strategy, studies of revi- 
sion in foreign language writing have shown that 
revision is typically more frequent in L2 writing 
than in L1 writing (e.g., Thorson, 2000) and that 
L2 writers focus more on the linguistic demands 
of text production than L1 writers (e.g., Stevenson, 
Schoonen, & de Glopper, 2006). 

Constant interruption of the writing process 
not only affects writing fluency but also puts pres- 
sure on writers’ working memory (Chenoweth & 
Hayes, 2001; Ransdell, Arecco, & Levy, 2001). 
Thus, if learners are faced with too many tasks 
or tasks that are too complicated, the learner’s 
noticing of language features is likely to suffer 
and their abilities as reflective learners reduced. 
Most of the learners’ cognitive capacity in such 
situations is focused on the task, per se, and not 
on the noticing of linguistics feature or reflective 
learning. 
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A number of ways to reduce learners’ cog- 
nitive loads or to distribute them over time by 
providing learners with opportunities to reflect 
and learn have been investigated. These include, 
the using multiple writing opportunities, the use 
of observational learning and Peer-Based Inter- 
vention (PBI). Chanquoy (2001) investigated how 
multiple writing opportunities could be offered 
to writers as an approach to distribute cognitive 
load and thereby enhance reflection and noticing. 
In her study, the writers wrote a first version of a 
text, went home, and then came back to revise the 
text on another occasion. It was found that writers 
make more text-based revisions during the second 
writing opportunity. Noticing and reflection were 
enhanced during the second writing opportunity 
as the writers did not have to use their cognitive 
resources to create the text. This allowed them 
to reflect upon the text, notice aspects of the text, 
revise and perhaps learn. 

Braaksma, Van den Bergh, Rijlaarsdam and 
Couzijn (2001) and Braaksma, Rijlaarsdam and 
Van den Bergh (2002) investigated the impact of 
observational learning on a learner’s reflection, 
noticing, verbalization and discussion. In their 
experiments a learner observes a peer composing 
a text. During observation, learners do not have 
to focus their attention on producing text but can 
devote their entire cognitive resources towards 
observing how a text is being created and reflect 
upon what they are observing. 

A variation on the observational learning 
approach has been investigated in studies using 
computer key-stroke logging technology. Sullivan 
et al., (1998) overviewed some of the potential 
uses of computer key-stroke logging as tool to 
enhance language acquisition. They illustrated 
how the replay function could be used by both 
the teacher and the learner to pinpoint areas for 
learning. Sullivan and Lindgren (2002) illustrated 
how computer keystroke logging could be used to 
support self-assessment in autonomous computer- 
aided L2 writing. In their research they investi- 
gated how four writers reacted to observing how 
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they had written a text. Each of the four students 
reflected upon how they had worked with theirs 
texts and felt that this approach to developing 
reflection and awareness of how they had written 
was a useful learning experience. 

The positive experience of computer keystroke 
logging reported in Sullivan and Lindgren (2002) 
together with the findings of Braaksma etal. (2001, 
2002) led Lindgren and Sullivan (2003) to trial 
the use of Peer-Based Intervention in a case study 
of two young female writers. 


PEER-BASED INTERVENTION 
USING COMPUTER KEYSTROKE 
LOGGING 


Peer-Based Intervention, with computer keystroke 
logging at its core, is conducted in pairs or groups 
and is an interactive experience with roots in 
stimulated recall (Gass & Mackey, 2000). The 
objective is to stimulate in-depth reflection on 
the computer keystroke-logged writing sessions. 
In typical Peer-Based Intervention sessions the 
two writers consider their own texts’ evolutions, 
and that of their peer. The writers are encouraged 
to focus and reflect upon various aspects of their 
writing which could include thoughts and ideas 
surrounding the revisions they undertook during 
their text’s creation and what they were thinking 
about when they paused during writing. Through 
verbalisation and peer and teacher feedback, PBI 
can help writers become aware of linguistic and 
extra-linguistic features of theirtexts necessary for 
text improvement and language development. 
A typical session of Peer-Based Intervention 
using computer keystroke logging, as used in the 
experiment reported in this chapter, begins with 
each learner writing a text that is logged using 
computer key-stroke logging software (e.g., JEdit, 
Severinson, Eklundh, & Kollberg, 1996). Then 
immediately after the writing task has been com- 
pleted, the writers use the replay function that is 
available in keystroke logging software to view 
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their texts’ evolution. This viewing is conducted 
in peer pairs. In the experiment reported here a 
teacher was always present. While replaying the 
text and observing its evolution, the writer de- 
scribes and explains as carefully as possible what 
went on during writing. This includes reflection 
upon the thoughts the writer had during pauses in 
the text production and reflection upon the reasons 
revisions were conducted during the text’s evolu- 
tion. The stimulated recall affords the writer the 
opportunity to reflect upon what was, and what 
was not, successful and helps the writer identify 
areas on which to focus their future study. This 
process of observing one’s own writing further 
affords the possibility to notice both successful 
and language and/or writing features that were not 
noticed during writing. In this regard this element 
of PBI is similar to that of observational learning 
(see for example, Braaksma et al., 2001). 

Peer-Based Intervention extends the reflection 
and noticing that the computer-based keystroke 
log reply can promote through the comments and 
discussions that are instigated by the peer and the 
peer’s ability to question and discuss the reflec- 
tions verbalized by the writer during the replay 
session. In this way, the writer’s verbalizations 
that, per se, assist in developing metacognitive 
awareness and promote learning and can be 
extended by the peer’s questions, thoughts, and 
the discussion. 

During the Peer-Based Intervention it is not 
only the writer who is able to reflect. During 
the replaying of the writing session the peer is 
an observer of another writer’s writing process. 
During such observation sessions more cogni- 
tive resources can be devoted by the observer 
to the noticing of language and writing features 
than during the composition of their own texts 
(Braaksma et al., 2001, 2002). Thus, the PBI ses- 
sion based around computer keystroke logging 
lifts the reflection level of both the writer and 
the observer. 

In the variant of Peer-Based Intervention used 
inthe experimentreported in this chapter a teacher 


was always present. The teacher’s role in our study 
was to both prompt talk when necessary, by, for 
example asking the writer “What are you doing 
now?” or “Can you talk about that revision?” and 
to provide the students with appropriate focus on 
form information (Swain, 1998) and text cohesion 
and development tips if they requested them. 

The presence of a teacher can help focus the 
reflection, assist the writer’s reflection and the 
peer’s observations. Furthermore, a teacher, 
whether actively part of the discussion or as a 
passive observer, can discover which features 
the writer notices and use these observations to 
target and individualize instruction for the student 
writer in question. 


USING PBI IN THE HIGH SCHOOL 
EFL CLASSROOM 


To demonstrate how PBI using computer keystroke 
logging can be implemented to support reflective 
language learning, we presenta study conducted in 
Sweden ina High school English class. The study 
examines the impact of the approachand considers 
whether learners react differently in their uptake 
of PBI and whether the type of text being written 
inthe foreign language impacts upon PBI’s uptake. 
The study does not ask whether the teacher found 
the approach useful for individualization of the 
curriculum or whether the individual writer’s 
found themselves reflecting upon their writing 
in new ways. We, among others, have in earlier 
work demonstrated these outcomes for PBI using 
Computer Keystroke Logging and for individual 
reflection using computer keystroke logging as a 
personal form of observation. 


The Participants 
The participants were 10 13-year-old first language 
Swedish speakers, six female and four male. All 


were volunteers from the same year-seven class 
with good computer skills who reported that they 
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regularly used computers. All of the participants 
have been exposed to English via the media since 
birth (e.g., English language films and televi- 
sion programmes are not dubbed in Sweden). 
The participants had had seven years of formal 
English instruction by the time they took part 
in the investigation. None of the participants, 
their parents/guardians or their schoolteachers 
reported that any of the participants had any 
known reading or writing problems. All of the 
participant’s parents/guardians were informed 
about the project and had given their consent to 
their child’s participation in the study. 


The Design 


Prior to writing, the participants were given ele- 
ments taken from the diagnostic EFL tests for 
school years 6 to 9issued by the Swedish Ministry 
of Education. The parts of the test given to the 
participants were the reading comprehension and 
short free writing task. This provided us with an 
indication of each participant’s EFL competence. 
This test is hereafter referred to as the Pre-test. 

The class teacher placed the participants into 
pairs. The class teacher was asked to create pairs 
that would be comfortable with each other, that 
would limit the degree of anxiety associated 
with showing another 13-year old their writing 
process and that would best promote reflection 
and discussion. 

Following Lindgren (2004), the study was 
divided into two periods in order to study any 
possible sequencing effects. For example as 
Lindgren wrote: “if the writers who started in the 
PBI condition receive higher marks on the texts 
composed without PBI during the second period, 
a possible transfer effect could be the explana- 
tion” (Lindgren, 2004, p. 268). During period 1, 
two of the peer pairs (Group 1) used the computer 
keystroke logged version of their texts for a Peer- 
based Intervention session with a teacher present 
directly after writing their texts. The PBI session 
discussion was audio tape-recorded. The other 
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three peer pairs (Group 2) went away directly after 
the first writing session and did not take part in 
a Peer-Based Intervention session. 

During the second period Group 2 took part in 
Peer-Based Intervention sessions using the com- 
puter keystroke logged versions of theirtexts with 
a teacher present and Group 1 did not. The PBI 
session discussion was audio tape-recorded. 

The participants were given the descriptive 
text task addressed to a familiar audience: “You 
have a pen-friend of your own age in Australia. 
Write a letter to him/her and tell him/her about 
your home and your room” and an argumentative 
text types addressed to an unfamiliar audience: 
“Your school needs more activities for the stu- 
dents in the breaks. Write to the municipality to 
convince them to give your school more money 
for activities.” The order of text types tasks was 
distributed between the peer pairs so that ap- 
proximately 50 percent of the participants started 
with the descriptive text and 50 percent with the 
argumentative text. When assigning tasks, the 
PBI condition was also taken into account so that 
approximately half of the participants in each 
condition began with the argumentative test and 
half with the descriptive text. 


The Procedure 


The writing sessions took place ina separateroom 
inthe school andthe participants lefttheir ordinary 
class to participate in the study. Each Peer-Based 
Intervention pair was assigned a different time to 
undertake the tasks. 

At the beginning of the each writing session 
the participants were informed that their writing 
sessions would be recorded. At the beginning of 
the first writing session they were told that they 
would be giventwo writing opportunities to com- 
pose each of texts, the topic of their composition 
task and writing instructions, and whether they 
would be taking part in a Peer-Based Intervention 
session that day or not. 
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The guidelines given to the participants at the 
beginning of the first writing sessions were “to 
work as usual with their text, write around half 
a page of text and write for around half an hour.” 
It was made clear to the participants that they 
were the ones to decide when they had finished 
writing; neither text length nor time limit should 
determine when the text was finished. It was pos- 
sible for the participants to use more or less time 
and/or write a longer or short text than asked by 
the experimental leader, one of the authors who 
is an experienced EFL teacher. 

Immediately after the participants who were 
taking part in a PBI session had finished writing, 
a PBI session with a teacher present was run. 
The PBI sessions were audio tape-recorded. The 
participants who did not take part in a PBI ses- 
sion returned to the classroom directly after the 
writing session. 

Atthe beginning of the second writing session 
the participants were asked to “Improve your text 
in whichever way you like.” The time limit for 
the second writing session was 15 minutes. This 
limit was chosen based on experience of teaching 
this age group and has been found to focus the 
writers’ attention on the task. 

At the end of the experiment, all the keystroke 
logged texts were coded. The coding system 
indicates the gender of the writer, the task type, 
whether the writing session was the first or 
second writing session and that the text was an 
EFL text. 


Analysis 


The analysis replicates Lindgren’s (2004) analysis 
of the L1 Swedish texts collected as part of the 
same project. The analysis first examines aspects 
of text quality and then considers the nature of the 
revisions undertaken by the participants during 
the writing session. The focus of the analysis is 
on the impact of Peer-Based Intervention on the 
participants’ writing. 


Text Quality 


Two qualified EFL teachers independently graded 
the texts based on the guidelines and examples 
provided in the teacher’s manual for the writing 
part of the “National subject test of English, year 
9” (for an example see National Tests of Foreign 
Languages, 2005). The guidelines emphasise that 
texts should reflect a willingness and an ability 
to express content comprehensibly and that texts 
should be assessed according to both content and 
language. 

The assessment of content is based on co- 
herence, structure, adaptation to audience, and 
purpose. The assessment of language is based on 
comprehensibility, fluency, sentence structure, 
vocabulary, and idiomaticity. 

In the national test, the grades IG (below pass), 
G (pass), VG (very good) and MVG (excellent) are 
used. For the purpose of this study these grades 
were transformed into figures where the maximum 
grade given was 45 marks: G > 20, VG > 34 and 
MVG > 40. The marks were divided between 
content (25 marks) and language (20 marks). 
Correlation tests (Pearson’s) showed that the two 
judges’ grades correlate significantly (p<0.01) in 
both sub-grades: Content r=0.86 and Language 
t=0.87. The inter-rater reliability was further 
confirmed with Cronbach’s a: content a=0.927 
and language a=0.927. The final grade for each 
text is the average of the two judges’ grades. 


Revisions 


The revision analysis program Trace-it (Severin- 
son et al., 1996) was used to assist in the manual 
analysis of the 4270 revisions in the data. All the 
revisions were analysed according to the online 
revision taxonomy presented in Lindgren and 
Sullivan (2002). The taxonomy defines revisions 
according their effect on the text written so far, 
that is, whether they affect the text on a formal or 
a conceptual level (c.f. Faigley & Witte, 1981). 


195 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Supporting the Reflective Language Learner with Computer Keystroke Logging 


Form revisions do not affect the content of the 
text and include, for example spelling or grammar 
revisions, and meaning-preserving substitutions 
or deletions. Example (1) illustrates a surface 
revision of spelling. The word “relly” is spelled 
incorrectly and revised correctly into “really”. 
An arrow (->) separates the phrase before and 
after revision. 


1. __....s0 it’s relly full house. > ...so it’s really 
full house. 


Conceptual revision includes text-based 
changes which affect the content of the text and 
“balance changes” which affect the text on a sty- 
listic level. These two categories draw on writers’ 
linguistic as well as extra-linguistic knowledge 
of, for example, task, style and audience (Van 
Gelderen & Oostdam, 2004). In Example (2), the 
writer changes the opening phrase from “Hi” to 
“Dear”, a revision that affects the stylistic level 
of the text. 


2. Hi Marie > Dear Marie 


In this analysis, “balance changes” include 
pre-contextual revisions. These revisions occur 
at the end of the on-going text and can be used 
to shape form as well as concepts during text 
production (Lindgren & Sullivan, 2006) (also 
referred to as point of inscription revisions, 
Stevenson et al., 2006). However, as they do not 
have any full context they are difficult to define 
without additional information from the writer. 
Example (3) illustrates a sequence including two 
pre-contextual revisions. The writer starts writ- 
ing “The da”, stops, deletes it and writes “We 
alway”, stops again before the phrase is deleted 
and replaced by “Everything we do...”. 


3. The da > We alway —> Everything we do 


on Christmas goes after the same old tradi- 
tion... 
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Without additional information itis difficult to 
determine with certainty whether these revisions 
affect the text on a form or a conceptual level. As 
additional data was not available, pre-contextual 
revisions could not be categorised into “form” 
or “conceptual”. However, text-elaboration at 
the point of inscription indicates positions in the 
developing discourse where the writer is deciding 
how to formulate or proceed with the composition, 
ie. “balance” the discourse. 

After analysis, the revisions have been stan- 
dardized by total number of characters typed in 
the composing of each text. Typographical revi- 
sions are not included in the analysis. 


Statistical Analysis 


Repeated measures analyses of variance (ANO- 
VAs) were used for statistical analysis of text 
quality and revisions. The analysis replicates 
the analysis of the L1 text presented in Lindgren 
(2004). The dependent variables were Quality, 
Surface changes, Text-based changes and Bal- 
ance changes (see Table 1 for an overview). Apart 
from the dependent variables the four ANOVA 
designs were identical. Three within-subject 
variables were used in the defined by the differ- 
ent writing conditions the writers undertook: PBI 
with two levels (PBI and No-PBI), Text type with 
two levels (Descriptive and Argumentative) and 
Version with two levels (Version 1 and Version 
2). One between- subject variable, Sequencing 
Effect, was used in all four designs. Finally, one 
covariate, EFL ability, was used as EFL ability 
was considered a factor that was likely to influ- 
ence all writing conditions. 

The a-value was adjusted to compensate for 
the different ANOVAs and the relatively small 
number of individuals (N=10) included in the 
test. Results where p<0.01 will be considered as 
significant. However, results where P<0.05 and 
p<0.10 will be reported in the Appendix as they 
can indicate trends in the material and assist in 
interpretation of the results. 
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Table 1. Overview of the definitions of the dependent variables 


Dependent Variable Short-definition 
Defined by the marks of the two judges 
Grammar, spelling and punctuation changes 


Text-based Revisions of content 


Revisions of style 


RESULTS 


Descriptive data for the four dependent variables 
Quality, Surface, Text-based (TB) and Balance 
revisions is presented in Table 2. Overall, the 
results show large variation between the writers, 
whichis illustrated by the high standard deviation 
figures, particularly in the revision designs. This 
calls for caution when interpreting the significant 
effects. In the sections below, the statistics will 
be complemented with examples from individual 
writers’ results in order to shed more light on the 
variation in the data. 


Text Quality 


No significant effects were found for Quality in the 
analysis of the EFL texts (see Table 2). However, a 
closer look at each individual participant’s results 
show a more varied picture. No writer increased 
the mark achieved for their texts between Ver- 
sion 1 and Version 2 by more than 1.25 marks. 
Three participants did not improve their texts 
in any of the conditions and three other writers 
improved their texts in all four conditions. Five 
of the participants improved their texts most in 
the PBI conditions. 


Table 2. Descriptive statistics of the dependent variables surface, text-based (TB), balance revisions 


and quality 


PescRPrve ARGUMENTATIVE 
[PBI No PBI No PBI 


0.07 | 0.21 | 0.06 | 0.07 | 0.08 | 


| Balance Mean | 0.88 | 0.21 | 0.90_| 
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One writer, Olle, received 4.75 marks less for 
the second version of his No-PBI (written withouta 
Peer-Based Intervention session after the first writ- 
ing session) descriptive text. This lower grade can 
be explained by the fact that in his second version 
he had replaced some characters with symbols, 
which made the text difficult to read. Example (4) 
illustrates how “e” was replaced by “3”. 


4. Some of the teachers — Som3 of th3 
t3each3rs 


Revisions 


The results of the analyses showed a tendency 
for more Surface changes to be undertaken in 
the PBI condition than the No-PBI condition (F 
= 3.43; p = 0.104; np2 = 0.33). 

Another tendency found in the data was that 
both high and low EFL ability writers revised 
more TB in the PBI condition (see Appendix 
Table 3). However, aninteraction effect was found 
between PBI, Text type, Version, and Ability (F 
= 6.35; p < 0.05; np2 = 0.49). In the descriptive 
texts both high- and low-ability writers revised 


more in the PBI condition while writing Version 
2 than the No-PBI condition. The opposite was 
found in the argumentative texts, in which both 
groups revised less TB in the PBI condition while 
writing Version 2. 

The results also indicate that both high and 
low EFL ability writers revised more TB during 
writing of their first text versions than during the 
second versions. However, for high ability writers 
the difference in TB revision frequency between 
Version 1 and 2 was lower in the PBI condition 
than in the No-PBI condition in the descriptive 
Text type and higher in the argumentative Text 
type. Thus, after PBI high EFL ability writers 
revised more in the descriptive texts but less 
in the argumentative texts than in the No-PBI 
condition. For low EFL ability writers the dif- 
ference between Version 1 and 2 in TB revision 
frequency was larger in the PBI condition then 
the No-PBI condition for both Text types. Thus, 
PBI did not stimulate low EFL ability writers to 
revise more TB. 

A significant effect (p < 0.01) was found in the 
Balance design. Aninteraction effect between PBI, 
Text type, Version and Ability was found (F = 


Table 3. Significant results of the statistical analysis for text quality and surface, text-based (TB) and 
balance revisions in the EFL text, F-values and Effect size (partial Eta squared) values. *=<0.10, 


**=p<0,05, ***=p<0.01 


VARIABLES 
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RESULTS 


F (mp2) | F (mp2) F (np2) 


6.01** (0.40) | 3.63* (0.34) 
5.99** (0.46) | 3.54* (0.33) 


5.61e* (0.44) | 
493* 4) | 
7.19** (0.51) | 18.20*** (0.72) 
6.66** (0.49) | 16.07*** (0.70) 
| Cd S.90** (0.46) 


| | 6.60%" (0.49) 
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16.07; p <0.01; np2 =0.70). Both high and low EFL 
ability writers revised more Balance during writ- 
ing of their first versions than the second versions 
of their texts. After PBI, the writers also revised 
more Balance in the descriptive texts but less in 
the argumentative texts. However, the difference 
inrevision frequency between Version 1 and Ver- 
sion 2 varied across level of EFL ability. 

For low EFL ability writers the difference in 
Balance revisions was smaller in the descriptive 
PBI condition than the no PBI condition, but 
larger in the argumentative PBI condition. This 
indicates a positive effect of PBI using computer 
keystroke logging for low EFL ability writers for 
the descriptive Text types, but not for argumenta- 
tive Text types. 

For High EFL ability writers’ the difference in 
Balance revisions between Version 1 and Version 
2 was smaller after PBI inthe argumentative texts 
and similar in the descriptive texts, regardless of 
PBI. This indicates a positive effect of PBI using 
keystroke logging for high EFL ability writers in 
the argumentative Text type. 


Variation between Writers 


The results of the statistical analysis indicate that 
the effect of PBI varies across both learners and 
Text types. Learner ability impacted on most of 
the significant results and was particularly strong 


in the Balance revision design. PBI seemed to 
induce all writers to revise more Form. After PBI, 
the high EFL ability writers revised TB more 
in the descriptive texts and Balance more in the 
argumentative texts, while PBI only affected the 
low EFL ability writers to revise more Balance 
in the descriptive texts. 

The descriptive statistics, however, show 
large variation between writers; Three writers, 
here known as Annika, Pippi, and Kalle, who 
reacted differently to PBI have been examined 
in detail. 

The results of the statistical analysis showed 
that EFL ability interacted with several of the 
significant or near significant results. According 
to the pre-test results, Annika, Pippi, and Kalle 
had different EFL abilities (See Table 4). Out of 
the 10 participants, Annika scored lowest on the 
pre-test with 67 marks, Pippi was close to aver- 
age with her 83 marks, and Kalle was one of two 
writers who scored 100. 

Annika improved her texts in all four condi- 
tions and she improved her text quality more after 
PBI (see Table 3). With the exception of her text 
in the No-PBI descriptive condition, the graders 
judged all her version 2 texts to be better than 
her version 1 texts in terms of concepts, that is, 
content, audience and style. Annika was also 
the most extensive reviser of these three writers 
and she revised Surface, TextBased, and Balance 


Table 4. Descriptive statistics of Pre-test results, average grade of all essays and improvement in text 
quality between Version 1 and Version 2 in four conditions 


RE-TEST | AVERAGE GRADE | GRADE 
ee 
Max oe | 


All essays 
ee 45 


NoPBI No PBI 


|Kalle | 100 | 29.0 «0.00 | 0.00} 0.00 | 0.00__| 
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more after PBI, particularly in the descriptive 
Text type (see Table 5). Thus, PBI using computer 
keystroke logging is used way of awareness rais- 
ing for Annika. 

Pippi improved her texts in all four conditions 
(see Table 4). The descriptive text improved more 
after PBI while the argumentative text quality 
improved to the same degree regardless of whether 
PBI was used or not. She revised less than Annika 
and her Surface and TextBased revision frequen- 
cies in the second versions are similar with or 
without PBI (see Table 5). Balance revisions are 
more frequent after PBI which indicates a raised 
awareness of audience and style in both descriptive 
and argumentative texts. Pippi’s improvements 
in the PBI descriptive condition and the noPBI 
argumentative condition were of a conceptual 
character. In the noPBI descriptive condition 
she improved in form. In Pippi’s case, that she 
could write her texts on more than one occasion 
was an important factor and PBI using computer 
keystroke logging enhanced her awareness of 
audience and style. 

According to the pre-test, Kalle was one of 
the high EFL ability participants in the study. 
Neither PBI nor an extra writing opportunity 
had any effect on Kalle’s text quality (see Table 


4). He revised form issues during both the first 
and second writing sessions. Yet, PBI did not 
affect his revision behaviour (see Table 5). Kalle 
did not revise TB in any of his texts. This does 
not, however, mean that Kalle did not consider 
content while writing. Conceptual processing 
during writing is represented as planning, reading 
of previously written text as well as revision and 
can be represented by pauses as well as revisions. 
A close analysis of pauses in the log-files could 
reveal difference in terms of pausing between 
the three writers. 


DISCUSSION 


The language learning classroom based study 
presented in this chapter found that the impact of 
Peer-Based Intervention using computer keystroke 
logging varied between participants. The method 
was most successful for the pupils who achieved 
a low score on the pre-test. It was also found that 
the PBI had the greatest positive impact on the 
descriptive assignments. 

It is possible that visual replay of the writing 
process drew the participants’ attention and reflec- 
tion to the point of inscription and that this inturn 


Table 5. Descriptive statistics for surface, text-based, and balance revisions in three writers’ texts 


oe 


Annika | Surface 


Balance 


Pippi Surface 
Balance 
Kalle Surface 
Balance 


B 


| Surface | 2. 
[TB | 
| Balance | 0. 
| Surface _| 0. 
| Balance | 1. 
| Surface | 1. 
| Balance | 0. 


200 


> 


rgumentative 


uw 
4 


S 
4 
_ 


ww 
fap) 
ul 
o 
fon) 
uo 


Pile|R 
NRJelNM 
SOlO|N 
Soljo|o 
BRIRIB 
uftR te 


RloO 
Nie 
OIN 
o 
ran 
_ 
PYo|S fe 
DAyeIN w 
U1] M10 & 


o 

uw 
N 
oO 
N 


- 
N 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Supporting the Reflective Language Learner with Computer Keystroke Logging 


focussed the writers’ thoughts on local aspects of 
their texts. The global style and content aspects 
of the foreign language texts would therefore 
have received less attention and reflection leav- 
ing inconsistencies more frequently undetected 
and unrevised. This effect was most clearly seen 
in the argumentative tasks where the demands 
on choice of vocabulary choice and grammati- 
cal construction can lead the foreign language 
learner to overstretch their capacity more so than 
in a descriptive task. The ability level and age of 
the language learners coupled with their school 
learning environment probably strengthened 
their focus and reflection on, and revision of form 
aspects of their writing. 

Learner personality, motivation and attitude 
impact upon how well a learner responds to 
tasks that demand reflection. This difference is 
well illustrated by how Kalle and Annika used 
the reflection opportunities offered by PBI using 
computer keystroke logging. Both of these lan- 
guage learners were confident in their comments 
about their texts. 

Annika was confident about her text and in the 
discussion with her peer; she brought up many 
items she had revised for discussion, feedback and 
reflection. The PBI session helped her reflect upon 
her text and led to revisions that were a result of 
the discussion during the second writing session. 
Annika was receptive of the method and used it 
to trigger reflective learning. Kalle, on the other 
hand, was equally confident about his text in the 
PBI discussion, yet he repeatedly said that when 
he had finished writing a text and that he could not 
see any need for further revision. He felt neither 
the context nor language of his text need to be 
revised to be improved or to remove grammatical 
or spelling errors. Kalle was not receptive to the 
use of computer keystroke logging as a method 
of promoting reflection in the language learner as 
applied in the study reported in this chapter. 

Chan and Kim (2004) wrote: 


... any foreign language curriculum that aims to 
promote autonomy must focus on putting learn- 
ers in control of their linguistic and learning 
processes. It must therefore be process-oriented 
and take into account learners’ individual needs, 
preferences, learning processes and proficiency. 
(p. 85) 


The difference in Annika and Kalle’s reac- 
tion to PBI using computer keystroke logging 
demonstrates the importance of, as Chan and 
Kim (2004) pointed out, taking into account the 
differences in the way language learners’ approach 
their language learning when they are put in 
control of the learning experience. The use of the 
computer to enhanced reflection in the teaching 
of a foreign language, thus, needs to be directed 
and structured by well-organized teacher-student 
and student-student collaboration to maximise the 
student learning outcomes. 

The outcomes were limited for the argumen- 
tative texts. This could have been due to lack 
of background knowledge by the students. This 
would have restricted what they could write and 
the ways in which the writers could construct their 
arguments. The topic could also have been too 
advanced or too simple for the writers. For this 
type of text, topic preparation by the teacher in 
advance of the writing task with the class may in- 
crease the impact of PBI and Computer Keystroke 
logging when writing an argumentative text. This 
approach would allow the students to start the 
task with the knowledge of how to construct an 
argument. In the experiment presented here, the 
writers were unprepared for the topic. This aspect 
of the use of PBI and Computer Keystroke logging 
warrants further classroom based research. 


CONCLUSIONS 


This chapter has discussed how Computer Key- 
stroke Logging software can be used for computer 
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enhanced language learning. In particular this 
chapter has overview how Peer-Based Inter- 
vention using computer keystroke logging can 
be used to promote reflection in the language 
learner. Previous research has demonstrated 
a range of positives for the foreign language 
educator whom by using computer keystroke 
logging can individualise teaching and provid- 
ing appropriate feedback to language learner; 
and for the foreign language learners whom can 
examine their own foreign language outline at 
their own pace (e.g. Lindgren & Sullivan, 2003; 
Sullivan et al., 1998; Sullivan & Lindgren, 2002). 
The study presented in this chapter showed how 
PBI using computer keystroke logging provides 
a tool that can be used for reflection and discus- 
sion of their own and a peer’s processing during 
the composition of a foreign language text. It was 
found that this promoted reflection and language 
awareness in the reflective learner but not in the 
non-reflective learner. How to use this computer 
enhanced approach to language learning to help 
the non-reflective learner to become reflective is 
the question that now needs to be addressed in 
applied linguistic research. This should involve 
both the development of the computer keystroke 
logging software and the classroom techniques 
associated with its use. 
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KEY TERMS 


Keystroke Log-File: The file that contains 
each keystroke action along with its time of oc- 
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currence. It is the information contained in the 
keystroke log that makes it possible to replay the 
writing process exactly as it occurred, and to 
analyse an individual’s writing process. 


Keystroke Logging: A piece of software that 
captures toa log-file every keystroke, mouse move- 
ment, cut and paste action made in a particular 
word processing environment. 


Language Awareness: Explicit knowledge 
about language, and conscious perception and 
sensitivity in language learning and language 
use. 


Learner Autonomy: The learner takes re- 
sponsibility for their own learning and works 
creatively in collaboration with teachers, tutors 
and other students. The autonomous learner criti- 
cally reflects on their experiences, creates their 
own ideas and challenges existing theories. 


Peer-Based Intervention: Reflection on and 
discussion of one’s own and a peer’s writing, 
drawing, design etc. processes 


Reflective Learner: Someone who focuses 
on their patterns, habits, and preferences as a 
learner, learns what works well for them and 
develops strategies for addressing or overcoming 
the parts of writing or analyzing literature that 
frustrate or puzzle them by listening, observing 
and sharing ideas. 


Stimulated Recall: The replaying of the 
writing process to the writer to stimulate them 
to remember how they thought when writing 
the text. 
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ABSTRACT 


The present study is situated in the context of cognitive aspects of language processing as it focuses on 
the learning and teaching of grammar in various modes of presentation. The success of the programs 
developed for, and used in, the study is measured in terms of short- and long-term learner performances 
in the application of grammatical rules. Four groups of informants were formed to test four different 
combinations of the presented materials. The groups used either a cognitive/functional or traditional 
rule-governed approach to grammar explanation in either an animation or static presentation mode. The 
results document the overall superiority of the cognitive/functional approach to grammar when presented 
in the animation mode. The design of the study and its results could serve as a reference point for further 
research and could help refine parameters for the evaluation of effective language learning software. 


INTRODUCTION 


The use of electronic media in language learning 
can be seen as the result of a wide variety of 
economic or pedagogic reasons, often driven by 
the aim to offer a method for accelerated learning. 
However, software producers and publishers 


rarely provide evidence for the success of their 
products. In other words, software often is not 
evaluated at all or evaluated in an introspective 
manner by means of checklists or reviews. While 
checklists allow for a more-or-less systematic 
and structured evaluation, the typical review 
includes basic information about the program 
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and the reviewer’s subjective description. The 
types of criteria found in a checklist and a review 
largely overlap (see Hubbard, 1992; Knowles, 
1992; Schmueckler & Shuell, 1989). Often the 
criteria employed in a review vary according to 
the reviewer’s taste. Rarely are they derived from 
a theoretical approach to evaluation. In contrast, 
empirical evaluations require an extended use of 
the materials by actual learners (see Scholfield, 
2000 for a detailed discussion). A survey of 
recent evaluation projects of an empirical type 
(Reeder, Heift, Roche, Tabyanian, Schlickau, & 
Gélz, 2001) has found a lack of methodological 
rigour and a lack of agreed upon methodological 
protocols inthe empirical assessment of language 
learning software. 

In order to provide more systematicity in the 
evaluation process, Hubbard (1992) argues for the 
application of a curriculum development approach 
to software evaluation as part of a triangular 
model for CALL courseware, the other two com- 
ponents being development and implementation. 
Within the model, Hubbard (1992) argues for the 
networked operation of these components in a 
framework which is similar to a curriculum and 
instructional scheme. In this way, software devel- 
opment, implementation, and evaluation can be 
explicitly related to instructional principles and 
their related components. 

Following Hubbard’s approach, Reeder et 
al. (2001), Hufeisen & Leitner (2007), Roche 
(2003) and Roche (2008) developed a criteria- 
based framework for software assessment while 
incorporating cognitive aspects of language 
processing and acquisition which were largely 
unconsidered in Hubbard’s model. While the 
profession is beginning to approach the issue of 
software assessment more systematically, more 
research is still needed in order to understand the 
fundamental principles of media-based language 
learning, that is, how the use of media leads to 
an added value in language learning and why 
positive effects of media use are often difficult 
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to measure. This is a long-term endeavour which 
is still in its initial phases. 

The study presented in this paper can therefore 
be no more than a small piece in a large mosaic 
whose overall size is yet unclear. It is rooted 
in the cognitive theory of multimedia learning 
(Mayer, 2005) and uses the integrated text and 
visual comprehension model (Schnotz, 2005) as 
well as the cognitive load theory (Sweller, 2005) 
as reference points. 

The aim of this chapter is to test the hypothesis 
that modern electronic media are particularly ef- 
ficient in language learning when they are prop- 
erly tuned to the cognitive processes of language 
acquisition and the coordinated processing of 
dynamic visual and verbal information. Based on 
this assumption, the authors of the present study 
first developed relevant design criteria which were 
then used in a comparative study involving four 
different modes of presentation on a particularly 
difficult grammatical topic. This particular gram- 
mar topic generates various, and often lasting, 
production errors for most learners of German as 
a foreign language (L2) regardless of their first 
language (L1). 

The design criteria derived from previous 
research led to the development of four instruc- 
tional units including a sequence of grammar 
animations on two-way prepositions in German. 
The success of the programs developed for, and 
used in, the study was then measured in terms of 
learner performance in the correct application of 
the grammar rules under investigation. A previous 
pilot study on related grammar topics conducted 
with fewer informants in a setting similar to the 
one designed for the present study had shown 
that learners’ performances increase, error fre- 
quencies decrease and retention improves when 
animations are used (Roche & Scheller, 2004). In 
the pilot study, 47 animations covering different 
grammar focus areas (such as syntax, two-way 
prepositions, pronoun es (it), word formationrules) 
were processed by a group of intermediate and 
advanced learners of German with different L1. 
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The results of the pilot study were instrumental 
in focussing the design of the study reported in 
the present paper. Overall, we used more detailed 
visual clues for the depiction of functional and 
semantic parameters. We also offered a longer 
viewing exposure to the animations and expanded 
the practice sequences for the informants. 


RESEARCH BACKGROUND 


The central element of the cognitive theory of 
multimedia learning (Mayer, 2005) is the dual 
coding theory (Paivio, 1986; Sadoski & Paivio, 
2004) which claims that the processing of verbal 
and visual information occurs in two function- 
ally separate representational subsystems in the 
semanticmemory. Asaresult, two separate mental 
projections are produced during the simultane- 
ous processing of verbal and visual information 
modes. 

Processing information in different modes and 
coordinating the processes relies on the availabil- 
ity of sufficient cognitive capacity as processing 
resources are not unlimited at any given time. 
An excessive demand on available capacity can 
produce an overload effect making it more dif- 
ficult or impossible for a learner to process the 
information or reintegrate it into a coordinated 
entity. The success of the learner not only relies 
on the availability of sufficient resources but also 
on the manageability of the resources. Cognitive 
overload can be caused by processing tasks which 
are irrelevant for learning. In these cases, the 
manageability of processing can be secured or 
restored by reducing the extraneous load. This 
component of the cognitive theory of multimedia 
learning is known as the “cognitive load theory” 
(Sweller, 2005). 

The strict separation of processing channels 
originally formulated in dual coding theory has 
received some criticism more recently which 
led to far reaching modifications (Engelkamp & 
Rummer, 1999; Engelkamp & Zimmer, 2006). 


Instead of assuming thatthe results of the separate 
processes are stored largely in separate ways and 
only recombined at a later stage, the modified 
theory emphasizes the benefits of an early and 
continuous coordination of semantic information 
on a non-modal processing level. A lack of an 
early and continuous coordination of semantic 
information received through different input 
channels would require largely independent and 
fairly inflexible processing structures in the brain 
as well as a lot of attention during the recombina- 
tion process. Early and continuous coordination 
of the different processes, on the contrary, relies 
on partially shared processing structures in the 
brain, divides the attention required for the pro- 
cessing into smaller tasks and allows for more 
flexible reactions when the processed informa- 
tion is complex, for example, when the visual 
and verbal input do not fully correspond or are 
modified during processing. 

However, it remains undisputed that the for- 
mation of referential connections between verbal 
and visual information and the construction of an 
adequate mental model which relies on informa- 
tion stored in the long term memory is essential 
for meaningful learning. Only when verbal and 
visual information is integrated into a common 
mental model can meaningful learning occur. This 
is known as the “generative learning principle” 
(Mayer, 2005). 

Mayer, Moreno, Boire, and Vagge (1999) and 
Mayer and Sims (1994) therefore stress the impor- 
tance of aclose temporal and spatial coordination 
of separately processed information for generat- 
ing positive effects on the activation of stored 
knowledge and retention of new information. This 
effect has become known as the “contiguity ef- 
fect.” Inlanguage learning a contiguity effect can 
occur when verbal information is accompanied by 
related and well coordinated visual information. 
In such instances, it can provide support for the 
learner’s mental processing of the content. If the 
processing is not coordinated, however, interfer- 
ences are likely to occur making it more difficult 
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for learners to process and retain the information 
(cf. the critical review of research literature in 
Seel, 2000). 

Within the integrated model of text and picture 
comprehension, the comprehension of verbal and 
visual information is described as a process in 
which multiple mental representations are con- 
structed and visualisation has a significant effect 
on the construction of mental models. Research 
by Schnotz (2005) provides empirical evidence 
to support this model. 

Since the constructed mental models are dy- 
namic in nature, we conclude that they might be 
best supported by dynamic forms of visualisation, 
that is, animations. As a result, when designing 
the experiment we expected that the groups work- 
ing with animated programs obtain better results 
than those working with static grammar presenta- 
tions. We expected a similar positive effect as a 
result of another design feature: a conceptual and 
functional presentation of grammar. We assumed 
that both design features would produce a cumu- 
lative effect. By combining the conceptual and 
functional presentation with a dynamic delivery 
system (i.e., in animations) we distinguished our 
experiment from Caplan’s study (2002). Caplan 
(2002) designed her comparative study of an ani- 
mated and static mode of presentation of German 
modal verbs based on conventional and formal 
teaching materials which she collected from 
common textbooks. Her hypothesis stated that 
word animations lead to a better understanding 
of morpho-syntactic grammar rules than static 
presentations. However, the results of her study did 
not confirm the hypothesis. The formal materials 
used in the study as well as the fact that modal 
verbs in German have few semantic connections 
to movement in our view provide only restricted 
use for animations and therefore can explain the 
negative results of Caplan’s study. 

In order to study the effect semantic and 
functional connections between the grammati- 
cal principles and the animation might have, we 
chose a grammatical topic which does reflect the 
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expression of movement as a distinctive feature: 
prepositions. Germanhas four distinct cases which 
express semantic roles in an utterance, such as: 


° Subject (nominative case) 

° Object (accusative) 

° Indirect object/receiver of an action (dative) 
and/or 

° Possession (genitive). 


These roles are often marked by prepositions. 
Consequently, nouns require anominative, an ac- 
cusative, a dative or a genitive marking, which is 
also expressed by the accompanying article. For 
more information on German grammar such as 
articles, please refer to Appendix A. 

Among the prepositions requiring a case 
marking is a small group of highly frequent 
prepositions known as the two-way prepositions. 
These prepositions can take both the accusative 
and the dative depending on their functions in 
a sentence. Two-way prepositions are governed 
by various grammatical, functional and semantic 
parameters which often are not well understood 
by language teachers and not well explained in 
textbooks and therefore pose a particular problem 
to learners. 

Local prepositions in German such as “in” 
(this corresponds roughly to “in” in English), 
“auf” (“on”), or “vor” (“in front of”) require a 
different case according to whether they mark 
a direction (thus requiring the accusative form 
of the article) or a location (thus requiring the 
dative form of the article). However, traditional 
grammar guides operate with a variety of more 
or less accurate criteria to explain the difference 
to students, ranging from the very formal ap- 
proach of prescriptive rule learning to contextual 
approaches using embedded context utterances 
in specific settings. A typical example for rule 
learning found in almost every German textbook 
would be: “The prepositions in, auf, vor, an ... 
require the dative to express a static position. 
They take the accusative with verbs of motion.” 
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Teachers often add: “The dative answers to the 
question wo?, the accusative answers to wohin?” 
(cf. http://www.canoo.net/services/OnlineGram- 
mar/Wort/Praeposition/Kasus/2Kasus.html). The 
differences of accusative and dative in German 
and their correspondences in English is illustrated 
in Table 1. 

The following example serves to illustrate 
the communicative context of the grammatical 
choice: 


1. The question: Wo fuhren Sie? (Where were 
you driving?) 


suggests that the speaker wishes to know on what 
static platform, location, or surface someone was 
driving. This is equivalent to the question “On 
what surface were you driving at the time?” (may 
be used in a court of law to establish whether the 
surface on which the defendent was driving might 
have caused the accident). In this case, the answer 
would be something like: 


... auf einer Landstrake 
. on a country road. (auf = on in Eng- 
lish). 
2. The question, Wohin fuhren Sie? (Where 
were you driving to?) 


suggests that the speaker wishes to know to what 
destination the person was driving towards. The 
answer that question could be: 


in die Stadt. 
... into the city). (This sentence suggests a 
movement to a place not a location.) 


However, asking the right question does not 
always result in the appropriate allocation of the 
case as such questions do not always lead to the 
right answer. The following example can serve 
as a counter example of why asking a “wohin” 
or “wo” question would not work: 


Wir fahren tiber die Briicke 
We’re | driving across the bridge 
Die: an article that marks the accusative 


This is because neither the question ,’wo 
fahren wir?” (“where are we driving?,” “wo?” 
dative, requiring der) nor the question “Wohin 
fahren wir?’(“where are we driving to?,” “wo- 
hin?,” direction requiring the accusative) leads 
to the accurate answers. Neither of the question 
words can appropriately capture the movement 
onto the bridge. Simplified textbook explanations 
therefore often fail to produce positive short- or 
long-term effects on students’ proficiency (Freitag 
& Vandermeeren, 2004; Wilmots & Moonen, 
1997). 


Table 1. Asummary of related grammar points in German 


jaccusative (wohin?) dative (wo?) 
German Sie hangte das Bild an die Wand. [Das Bild hangt an der Wand. 
English She hung the picture on(to) the wall. The picture is hanging on the wall. 
German [Du setzt dich auf den Stuhl. [Du sitzt auf dem Stuhl. 
English You sit down on(to) the chair. You are sitting on the chair. 
(German Wir legten uns in die Sonne. Wir lagen in der Sonne. 
English We lay down in(to) the sun. We were lying in the sun. 
German Sie rannten hinter das Haus. Sie spielten hinter dem Haus. 
English They ran behind the house. They played behind the house. 
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In contrast to formal descriptions of grammar, 
functional approaches have stressed the signifi- 
cance of the crossing of an (imaginary) boundary 
as the determining feature for the choice of the 
accusative with two-way prepositions (Freitag 
& Vandermeeren, 2004; Roche, 2005; Roche 
& Webber, 1996; Wilmots & Moonen, 1997). 
Consequently, the differentiating criterion for 
two-way prepositions is not the semantic feature of 
movement inherent to the verb but the functional 
feature of the marking of a boundary crossing in 
the meaning of the utterance. Accordingly, the 
location or movement within a given boundary 
or area is marked by the dative regardless of 
whether the verb expresses movement or not. This 
description is consistent with a model of cognitive 
grammar in which relations of moving objects 
in space are conceived as the contrast between a 
background (landmark) and the moving subject 
(trajector) (Langacker, 1999). A landmark repre- 
sents the spatial area in which a moving object is 
situated. Accordingly, the criteria for choosing the 
appropriate case in German are as follows: 


dative: the prepositional subject (trajector) re- 
mains within the immediate search area 
of the prepositional object (landmark); the 
landmark area is not being crossed, 
e.g. Der Hubschrauber schwebt tiber der 
Briicke. 
The helicopter hovers over the bridge. 


The trajector (subject) is “der Hubschrauber” 
(the helicopter); landmark is “die Briicke” (the 
bridge). 


accusative: the prepositional subject (trajec- 
tor) moves into the immediate area of the 
prepositional object (landmark) and crosses 
its boundaries. 
e.g. Wir fahren tiber die Briicke. 
We are driving across the bridge. 
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HYPOTHESES 


The hypotheses that motivated our investigation 
are consequently based on the assumption that 
conceptual and cognitive criteria pertaining to the 
dynamic processes of spatial markings described 
above are ideally suited for (dynamic) animations 
in multimedia learning. 

Two hypotheses were tested on the assumption 
that the functional concept of boundary crossing 
reflects the grammatical principles more adequate- 
ly than any formal or abstract description: 


1. Learners who are presented with func- 
tional-conceptual instructional units in 
any presentation mode yield better results 
in terms of learning the rules and applying 
them over an extended period of time than 
learners who are presented with traditional 
explanations. 

2. Learners who use functional-conceptual 
instructional units with computer anima- 
tions outperform all other groups in terms 
of learning the rules and applying them. 


Weexpected that the performance of all groups 
would drop over time unless the grammatical 
structures in question continue to be highlighted 
or are extensively used in further instruction. 
We assumed that a structure or rule which is 
better understood in the first place would lead to 
enhanced retention of that structure. 


METHOD 


The experiment took place in September 2006 
at the Linguistic University of Minsk (Belarus). 
Eighty-nine first year university students, aged 
17 to 22, who all spoke Russian as their L1 and 
were enrolled in the field of German Studies orthe 
translators programme participated in our study. 
Ninety one percent were female, nine percent were 
male students. Despite the fact that the students 
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had a first-year status at the university, they were 
all intermediate or advanced students of German 
and had been exposed to the grammar of two-way 
prepositions in their previous language instruction 
in public schools in Belarus. However, they had 
achieved different proficiency levels in German 
because of the highly variable quality of teach- 
ing conditions in public schools in Belarus. The 
results of the grammar pretest on the correct use 
of two-way prepositions are shown in Table 2. 

The dependent variable measured by the pretest 
was the choice of the right case with the two-way 
prepositions. To this end, participants of the study 
had to assign the accusative or dative case in the 
sentences presented to them. 

We then assigned the informants at random 
to four groups: 


1. A group that used functional descriptions 
in an animated mode (“boundary marking 
in animated mode,” GA) 

2. A group that used formal grammar descrip- 
tions in an animated mode (“wo-wohin in 
animated mode,” WA) 

3. | Agroup that used functional descriptions in 
a static mode (“boundary marking in static 
mode,” GS) 

4. A group that used formal descriptions in 
a static mode (“wo-wohin in static mode,” 
WS). 


Based onthe assignment, we conducted a vari- 
ance analysis (ANOVA) as a global comparison 
of all pretest results of all groups. The test did 
not produce a significant difference between the 
groups in the pretest (F=1.6, p=0.19, p>0.05). 

For the experiment we developed four different 
instructional units, each 45 minutes in length and 
containing instructional text passages, depictions, 
and exercises. The formal units were largely 
based on materials which are commonly used 
in textbooks for the teaching of German. For the 
functional units we based our design on criteria 
and concepts proposed by Roche and Webber 


(1996), Freitag and Vandermeeren (2004), and 
Wilmots and Moonen (1997). For group GA an 
animated instructional unit on two-way preposi- 
tions of about 45 minute length was developed. 
It consisted of 25 interconnected animations on 
two-way prepositions embedded in explanatory 
text passages and exercises. 

Following the pretest which consisted of a 
fill-in-the-blank exercise, we conducted the actual 
experiment after a brief introduction to the op- 
eration of the respective computer programs, the 
participants of the study had about 45 minutes to 
work through their units independently. They were 
asked to read the instructional texts and do the 
exercises only once and in the prearranged order. 
Immediately after the treatment, we conducted 
posttest 1 in order to measure short-term effects 
of the experiment. One week later, we conducted 
posttest 2 in order to assess long-term effects of 
the treatment. 

All three performance tests (Pretest, Posttest 
1, und Posttest 2) used identical or very similar 
test sentences in order to ensure comparability. 
However, some exercises were slightly altered 
with respect to their content, and the order of 
the test sentences was slightly modified to avoid 
interferences between the three tests, such as 
mechanical repetitions of learner answers (cf. 
Bortz & Doring, 2002; Diekmann, 2001). 

Following this, all groups were asked to 
fill out a questionnaire in order to evaluate the 
animations or the static presentations in their 
respective programs and inorder to obtain further 
qualitative data. This questionnaire is based ona 
study by Lewalter (1997) on learning with pictures 
and animations. Lewalter’s study focussed on 
the thematic interests of the learners including 
affective (“interesting”) as well as value-based 
components (“complicated.” “helpful”). It was 
chosen because it is designed to produce results 
which can be validated empirically and because 
it allows the measuring of emotional and value- 
oriented parameters in different dimensions. 
Finally, we were interested to study to what extent 
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Figure 1. A screenshot taken from a task in the animated instructional units. Picture 1 shows a car trav- 
elling on a road which requires the dative (der) as in “Das Auto fdhrt auf der StraBe” (on the road). 
Picture 2 illustrates the use of the accusative case (die) as in “Das Auto fdhrt auf die StraBe” (onto the 


road), thus crossing a boundary. 


Welche Animation passt zu diesem Satz? 
Das Auto fahrt auf der StraBe. 


students in the various groups were able to transfer 
the skills they acquired in the experiment to a 
meta-cognitive knowledge level. Such a transfer 
would indicate how well students have understood 
the grammatical principles and whether ornot they 
can monitor the correct or incorrect application 
of the grammatical rules with ease on their 
own. Results of a transfer test can be used as an 
indicator for long-term effects of the experiment. 
However, the findings of the transfer test are not 
presented or discussed here in further detail for 
brevity reasons. The issue of the development of 
meta-cognitive skills ina grammatical monitoring 
unit in language acquisition is discussed within 
its proper research context and illustrated using 
the complex supporting data of the transfer test 
in Scheller (2008). 
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RESULTS 


We used nonparametric methods (Mann-Whitney- 
Test, Wilcoxon-Test) for pair comparisons because 
of the small size of the groups and because these 
methods are robust in terms of the standard 
distribution hypothesis (cf. Zéfel, 2003). In 
addition, we used a mixed linear method for data 
analysis. This method uses randomized personal 
traits in the analysis of the data in order to test for 
possible influences which could have an impact on 
measuring the learning effects. Both effects, mode 
of presentation (static vs. animated) and concept 
of explanation (formal vs. conceptual), show 
highly significant results overall. The concept of 
explanation is significant on the 5 percent level 
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(p=0.000, no error probability). The presentation 
mode is significant on the 5 percent level (p = 
0.001, virtually no error probability). 

Table 2 shows that the standard deviation for 
GA is much smaller than for all the other groups. 
This suggests that the performances of students 
in GA are much more consistent than those of 
the other groups. Variation (STD) of GS and WA 
group actually increased in Posttest 2 whereas 
GA’s performances stayed stable (as indicated 
by the decreasing trend). 

In particular, the comparison of the results 
of the four groups in Table 1 shows that group 
GA (functional/animated) outperforms all other 
groups in both the posttests. This group shows 
a highly significant improvement in learning 


performance in posttest 1 (p =0.000). Also, com- 
parisons of group pairs in posttest 2 resulted in 
highly significant differences between group GA 
and all other groups (p=0.000). The comparisons 
did not produce statistically significant differences 
between the other groups. 

The group obtaining the lowest results is the 
one that worked with the formal “wo-wohin” 
explanation in the static presentation mode (WS): 
the performance did not change with respect to 
the pretest level. The other two groups show im- 
provement in posttest 1, but this increase is not 
significant and quickly dissipates as the sharp 
performance decline in posttest 2 indicates. 

Our hypothesis which claimed that a concep- 
tual approach to presenting grammar in conjunc- 


Figure 2. Boxplots of the four groups in relation to the three points of assessment (WS: formal/static, 
WA: formal/animated, GS: functional/static, GA: functional/animated) 
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Table 2. Statistical data for all four groups in relation to the three points of assessment 


Ws WA GS GA 
Pre Pl p2 Pre Pl p2 Pre Pl P2 Pre Pl p2 
Mean 15.6 | 15.7 | 159 | 146 | 161 | 158] 15 | 167 | 165 | 163 | 19.2 | 19.9 
Median 16 16 16 15,5 17 17 16 17 A7 17 20 20 
Std. Deviation) 2.46 | 2.01 | 2.42 | 2.89 | 2.78 | 2.91 | 2.96 | 2.51 | 3.06 | 2.48 | 1.98 | 1.53 
Key: 
WS: Formal/static 
WA: formal/animated 
GS: functional/static 
GA: functional/animated 
tion with an animated presentation mode would DISCUSSION 


produce a positive and lasting effect on learning 
was therefore clearly confirmed. Nevertheless, we 
were surprised by the fact that the other groups 
showed such minimal improvement and virtually 
no lasting effect of the instruction. 

We were also interested to see whether or not 
the performance of the students corresponds to 
their own assessment of instructional quality. To 
this end, we analyzed the respective comments 
made by the students on their post-experiment 
questionnaires. The analysis shows that the three 
groups of students performing best on the tests 
were generally satisfied with the quality of the 
instruction in our experiment. However, the WS 
group which received the lowest results does 
not rate the instruction as positive as the other 
groups (r (Pearson) = 0.218, p = 0.04). As was 
to be expected. These results indicate that the 
cognitive approach to teaching grammar using 
modern media does not only produce positive 
performance effects but appeals better to the 
students and therefore enhances their motivation 
to learn a foreign language. 
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Despite the fact that the learners’ L1 (Russian) uses 
two-way prepositions as well as the L2 (German) 
and despite the fact that the linguistic concepts 
of goal-orientedness and movement versus static 
position at a location show similarities in both 
the L1 and L2, learners produce a high number 
of errors. This is particularly noteworthy as most 
informants in this study hada fairly long exposure 
to German as their L2 before entering the experi- 
ment. Ananalysis of the errors using the students’ 
statements from the transfer test and questionnaire 
indicates that students make more errors when 
they do not fully understand the meaning of the 
verbs or the appropriate context of a verb. 

Particularly problematic are those sentences in 
which the motion expressed by the verb is wrong- 
fully associated with the accusative case: 


e.g. Der Junge lauft auf den Sportplatz (incor- 
rect) 
the boy is running onto (accusative) 
auf dem Sportplatz (correct) 
on the sports field (dative) 
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or 


Du kannst hinter den Bahnhof parken (accusa- 
tive) (incorrect) 
hinter dem (dative) Bahnhof parken (cor- 
rect) 
you can drive/park the car behind the sta- 
tion. 


Furthermore, a large number of errors occur in 
sentences such as der Bleistift ist auf dem (dative) 
instead of den (accusative) FuBboden herunterge- 
fallen (the pencil dropped to the floor). We suspect 
that a different case is chosen by the students in 
such instances because the goal-orientedness 
(movement) inherent to the verb meaning inter- 
feres with the perfectiveness of its tense marking 
(here present perfect) which students possibly link 
to a static result. This hypothesis is supported by 
the fact that an overproportional number of our 
informants in the formal groups produce case 
errors in the respective test sentences. 

In addition, the experimental studies conduct- 
ed by Wilmots & Moonen (1997) and Freitag & 
Vandermeeren (2004) support our claim as well. 
Our data sets show a clear division of the test 
groups: both formal groups produce an increase 
in errors in posttests 1 and 2, but error rates drop 
in both groups that worked with the functional 
concept as the main element for explaining the 
grammatical principle. The functional concept 
thus produces a more complete understanding 
of the rules. Moreover, the combination of the 
conceptual approach to grammatical rules and 
grammar animations enhances language learning 
more than any other mode. 


CONCLUSION 


The study leads to some preliminary conclusions 
as to the conditions of use of visual elements in 
language learning. It indicates that animations 
themselves do not automatically lead to an en- 


hancement in language learning. Rather, only 
animations constructed according to a closely 
defined set of didactic and functional (cognitive) 
principles are able to produce positive learning ef- 
fects. This might be the reason why Caplan’s study 
(2002), which relied on the grammar presentation 
of conventional textbooks, was not able to produce 
significant results on research hypotheses similar 
to ours. Itmust be noted that the participants of our 
study were experienced, linguistically interested 
and motivated learners who had a common first 
language (Russian) and shared a learning culture. 
Generalisation to all learners of German or all 
language learners subsequently is not yet pos- 
sible and therefore necessitates further research. 
A decision on the choice of design principles of 
animations for other language programs can only 
be reached after further research and analysis of 
the grammatical concepts in question. This not 
withstanding, many of the animations tested in 
the pilot study, as well as in the study reported 
here, are now being used in identical or modified 
ways in language learning programmes for Ger- 
man offered by the Deutsch Uni Online (DUO), 
a virtual language school with course offerings 
in German, English, French, Japanese, Mandarin 
Chinese, and Brasilian/Portuguese. These anima- 
tions already made their way into regular course 
offerings where, atthe same time, they are serving 
as research instruments for further studies. 
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KEY TERMS 


Case Markings: Languages such as Russian, 
French or Germanuse an inventory of grammatical 


cases to mark certain grammatical functions in 
a sentence, such as the subject (“doer of an ac- 
tion’”/nominative, object/accusative or “receiver 
of an action”/dative). In English, only the genitive 
case (Mary’s friend) explicitly is marked. The 
markings are generally expressed by endings of 
the nouns and/or, as in German, by particular 
forms of the articles. 


Cognitive Theory of Multimedia Learning: 
The central element of the cognitive theory of 
multimedia learning is the dual coding theory 
which claims that the processing of verbal and 
visual information occurs in two functionally 
separate representational subsystems in the se- 
mantic memory. As a result, two separate mental 
projections are produced during the simultane- 
ous processing of verbal and visual information 
modes. Processing information in different 
modes and coordinating the processes relies on 
the availability of sufficient cognitive capacity 
as processing resources are not unlimited at any 
given time. An exceeding demand on available 
capacity can produce an overload effect making 
it more difficult or impossible for a learner to 
process the information or reintegrate it into a 
coordinated entity. The success of the learner 
not only relies on the availability of sufficient 
resources but also on the manageability of the 
resources. Cognitive overload can be caused by 
processing tasks which are irrelevant for learning. 
Inthese cases, the manageability of processing can 
be secured orrestored by reducing the extraneous 
load. This component of the cognitive theory of 
multimedia learning is known as the “cognitive 
load theory”. 


Conceptual and Functional Presentation 
of Grammar: Other than formal and rule-gov- 
erned explanations of grammar, conceptual and 
functional approaches focus on understanding 
and explaining the underlying concepts as well 
as the semantic and pragmatic functions of gram- 
matical structures. They are often process-ori- 
ented approaches to language rather than merely 
structural ones. 
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Contiguity Effect: In language learning acon- 
tiguity effect can occur when verbal information 
is accompanied by related and well coordinated 
visual information. In such instances it can pro- 
vide support for the learner’s mental processing 
of the content. If the processing is not coordinated 
interferences are likely to occur making it more 
difficult for learners to process and retain the 
information. 


Grammar Animation: Grammar animations 
are used to visualize grammatical rules which are 
otherwise difficult to explain. Grammatical rules 
which express a movement or process are best 
suited foranimations. Abstract verbal descriptions 
or Static visual information often do not capture 
the essence of such rules. 


Prepositions: Prepositions are used in many 
languages to connect content words such as 
verbs, adjectives, names, nouns and pronouns 
to other content words. In languages such as 
English, French and German they often require 
an article (the, a, an in English) to connect to a 
noun. In German, that article generally marks 
the semantic function of the connected noun or 
a purely grammatical link using a particular case 
marking. The markings are frequent and often 
carry meaning. Two-way prepositions require 
a certain case marking based on whether or not 
they mark a change of location or a crossing of 
a boundary. Because prepositions are plentiful 
and require grammatical markings, they pose a 
particular problem to learners. 


Software Evaluation: The evaluation of soft- 
ware usually is done by applying non-systematic 
checklists to a particular program. More recently, 
theory-based approaches to software assessment 
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have been proposed which incorporate relevant 
criteria derived from linguistic, pedagogical and 
psychological models of language learning and 
teaching. 


APPENDIX A 


This is taken from http://www.learnplus.com/ 
guides/germangrammar03.html 

There are two kinds of articles in German: 
definite and indefinite: 


Definite articles are used to indicate specific nouns 
(e.g. the person of which we have already 
spoken in a speech, the thing about which 
we have already read in a written passage, 
etc.) The German definite articles are: 

° Singular masculine - der Brief [the 
letter] 

° Singular feminine - die Tasche [the 
bag] 

° Singular neuter - das Madchen [the 
girl] 

° Plural for all genders - die Leute [the 
people] 

Indefinite articles refer to nouns in a non-specific 
way. The German indefinite articles are: 

° Singular masculine - ein Tisch [a 
table] 

° Singular feminine - eine Zeitung [a 
newspaper] 

° Singular neuter - ein Glas [a glass] 
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ABSTRACT 


This chapter describes the design of a speech interactive CALL program and its evaluation with end 
users. The program, SPELL (Spoken Electronic Language Learning), combines speech recognition 
technology, embodied animated agents and virtual worlds in creating an environment in which learners 
can converse with virtual characters in the target language in real-time. Empirical results are presented 
from an experiment which evaluated user satisfaction of using the program and interacting with the 
characters, and speech recognition accuracy. The results detail the limitations of the speech recogniser in 
this context. However, data on user satisfaction clearly show that the system was perceived by language 
learners as being both useful and enjoyable. 


INTRODUCTION has been built for two languages, Italian and Japa- 
nese, and tested with end users, who are students 

This chapter describes the design and implemen- of the languages. 

tation of a speech interactive Computer Assisted The field of CALL is an increasingly interdis- 

Language Learning (CALL) program. A prototype ciplinary one. With the increase in sophistication 
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of technology in CALL comes an increase in the 
sophistication of the user. The performance of a 
CALL program is important in an evaluation; 
however, it also is essential to investigate users’ 
attitudes towards the program as user enjoyment 
and engagement are crucial to its success. 
User-centred design and usability studies are 
common in the field of Human Computer Interac- 
tion (HCI). Some researchers in the field of CALL 
advocate the consideration of usability issues in 
the design and evaluation of CALL systems (AI- 
lum, 2001). This chapter details the evaluation of 
a CALL program with usability issues taken into 
consideration. The purpose of the study was two- 
fold. Firstly, to investigate user perceptions of and 
attitudes towards the language learning program 
(the usability of the program), and their feelings 
towards interacting with the animated characters; 
secondly, to investigate the performance of the 
speechrecognition component. Data are presented 
on user satisfaction using the system and on user 
attitudes towards interacting with the characters. 
User response data on the utterances made while 
interacting with the characters are presented. 
Finally, performance data are presented on the 
speech recognition component of the program. 


THE CALL PROGRAM 


When learning a target language, unless in the 
country in which the language is spoken, op- 
portunities for interaction in the target language 
may be limited. A student studying a language 
in high school may receive only a few hours of 
language class per week and may have very limited 
one-on-one time with the teacher of the class. In 
the classroom situation, it is impossible, due to 
time restrictions and resources, for the teacher to 
engage in a spoken dialogue with every student. 
However, to make interaction meaningful, it is 
necessary that the speaker has an interlocutor 
with whom to interact. 
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In addition to resource issues, spoken language 
learning can be hampered by student anxiety. 
Feelings of embarrassment or stress when speak- 
ing in the target language may have an affect on 
learners’ language development and learning 
process. Language learners’ success can be af- 
fected by their motivation, self-confidence and 
anxiety. Successful language acquisition occurs 
when learners’ anxiety levels are low and their 
motivation is high. One of the perceived benefits 
of CALL programs is that the learners can work 
at their own pace, and if required in privacy. In 
other words, CALL programs have the ability 
to create an environment which may lessen the 
anxiety that can sometimes be present in the 
language learning context. 

Speech is an inherently social action which 
requires a co-participant in the dialogue. In a 
CALL program, co-participants can be cre- 
ated for the learner as speech-enabled animated 
agents, which can introduce a social aspect to a 
language learning activity and which crucially 
can be a virtual interlocutor with which a learner 
can practice their target language (L2) speaking 
skills. Speech recognition technology is used to 
allow the learner to interact with the character 
who can then respond to the learner in a number 
of conversational turns. Through aspeech enabled 
CALL system, oral language practice need not be 
restricted to limited class time. In addition, speech 
enabled CALL systems can also help students who 
feel anxious practicing their oral language skills 
in public (Wachowicz & Scott, 1999). 

This chapter describes the evaluation of a 
speech enabled CALL program. The program, 
SPELL, combines virtual worlds and animated 
agents with automatic speech recognition tech- 
nology to create a speech interactive CALL 
application in which learners can interact in the 
target language with the virtual characters who 
‘listen’ by means of the speech recogniser. The 
3D virtual worlds, created in VRML, depict the 
contextualized environment in which the interac- 
tion takes place. 
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Users interact in various dialogues with the 
animated agents within a defined context, in 
this case “At the café.” Based on the interaction 
hypothesis (Long, 1996), the animated agents are 
designed to offer modifications of their input in 
cases where the user appears to be having difficul- 
ties. Interaction provides learners with opportuni- 
ties to receive comprehensible input and feedback 
(Long, 1996; Pica, 1994; Gass, 1997). Further, 
interaction allows learners to make changes to 
their own linguistic output (Swain, 1985, 1995). 
The SPELL program provides modifications to 
the input and creates opportunities for learners 
to produce target language output. The aim in the 
program is for learners to engage in a dialogue 
with virtual characters within a defined context. 
Ithas been suggested (Garcia-Carbonella, Rising, 
Montero, & Watts, 2001) that the use of simulations 
in language education is beneficial to learners as 
they can enhance interactions through negotiated 
meaning. In the SPELL program, the learners are 
not told in advance what to say, nor are they given 
a finite list from which to choose their utterances; 
the speech recognition grammars are programmed 
with predicted responses for each individual stage 
of the dialogue, accounting for grammatical and 
some ungrammatical responses. By categorising 
the response types, feedback can be given to the 
learners on their output. 

It has been suggested (Wachowicz & Scott, 
1999) that implicit feedback, which does not 
explicitly state that an error has occurred, is pref- 
erable to explicit corrective feedback for speech 
interactive CALL systems as implicit feedback 
is likely to minimise potential problems resulting 
from imperfect speech recognition. Feedback in 
the SPELL program is given implicitly inthe form 
of recasts and reformulations. 

Animated agents are used inthe programas the 
target language interlocutors with whom the users 
interact. In pedagogical applications, animated 
agents have been described as “lifelike characters 
that facilitate the learning process” (Johnson, 
Shaw, & Ganeshan, 1998, p.2). Research in the 


use of animated agents in pedagogical applications 
has found that animated agents can improve the 
learning experience (Lester, Converse, Kahler, 
Barlow, Stone, & Bhogal, 1997; Massaro, 1998). 
It has also been found (Johnson, Rickel, & Lester, 
2000) that animated pedagogical agents are able 
to increase the computer’s ability to engage and 
motivate students. 

In the context of CALL, it has been suggested 
(Chapelle, 1998) that it may be important for 
learners to have an audience for their linguistic 
output so that the learners can “attempt to use the 
language to construct meanings for communica- 
tion rather than solely for practice” (p. 24). The 
use of animated agents together with automatic 
speech recognition technology in SPELL offers 
the language learner an opportunity for real-time 
conversation, where the animated agents serve as 
the audience for the language learners’ output. 


CONVERSATIONAL DIALOGUE 
SYSTEM 


In creating the conversational dialogue system, a 
semantic interpretation approach was adopted. In 
order to facilitate a dialogue with the learner, the 
system must understand the semantic interpreta- 
tion of the learner’s utterance. This can be achieved 
by including task-relevant semantic information 
in the grammar used by the speech recogniser, 
so that the outcome of the recognition process is 
not only a literal transcription of the utterance but 
also an interpretation of its meaning. The semantic 
information is expressed within the grammar in 
the form of slot-value assignments, where the 
recognition of a particular word or phrase leads to 
the filling of a semantic slot with the information 
contained in that word or phrase. By correctly 
understanding the semantic interpretation, the 
system can engage in a dialogue which may take 
a number of conversational turns. 

However, the system also is designed to offer 
feedback to the learners on their responses. For 
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this to occur, it must be able to identify ungram- 
matical utterances which have been predicted and 
pre-programmed into the speech recognition files. 
If the system detects that the learner has made an 
error in their utterance, the animated agent recasts 
the learner’s utterance. A sample dialogue between 
the animated agent and learner might be: 


Virtual Agent: What food does Katie like? 

Learner: Umm Katie like pizza. 

Virtual Agent: That’s right. Katie likes pizza. 
What food do you like? 


Thus, the system detects that the learner has 
responded appropriately for the context but the 
response contains a grammatical error (missing 
a “s” in “likes”), so the system offers some im- 
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plicit feedback to the learner on their utterance, 
pauses briefly and then moves the dialogue on to 
the next stage. 

If the learner does not respond, the animated 
agent repeats the question. If the system detects 
that the learner has given an answer that is not 
appropriate to the given question which the ani- 
mated agent has asked, the system “rejects” this 
and the animated agent reformulates the question, 
possibly offering a hint to the learner. These 
feedback strategies allow the dialogue with the 
learner to continue without explicit reference to 
a problem. This has the advantage of continuing 
the flow of the dialogue (and where necessary 
giving the learner another opportunity respond, 
or implicitly correcting their response); and, by 
being implicit in the feedback, this minimises at- 


Figure 1. Main lesson page: Italian “At the café” (© 2007, CCIR, University of Edinburgh. Used with 


permission) 
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tention to any potential errors made by the speech 
recognition component. 

The SPELL program offers the learner three 
scenario types within each “lesson:” observa- 
tional, one-to-one and interactive. Supplementary 
materials are also available to the learners to 
access if required: vocabulary, grammar files, a 
transcription of the observational dialogue, and 
cultural information. Figure 1 shows the main 
lesson page with the three scenario types depicted 
with thumbnails of the relevant screen shots on 
the left and links to the supplementary materials 
on the right. 

The observational scenario gives the learner an 
opportunity to observe the animated agents within 
the scene engage in a contextualized dialogue. 
The learner can watch the interaction between 
the animated agents in this scenario. Figure 2 


shows the animated agents in the observational 
scenario. 

When engaged in the scenarios, the learners 
have some control buttons which allow them to 
play, pause and stop the dialogue. Further there is 
a subtitles option where the learner can activate 
subtitles while the dialogue plays; maintaining 
the immersive target language environment, the 
subtitles are given in the target language (L2) only, 
rather than a translation into the first language 
(L1) of the dialogue. In the case of the Japanese 
lessons, as the participants taking part in the user 
evaluations may not be familiar with hiragana 
and kanji, the subtitles were provided in Romaji 
(the Romanization system). 

The observational scenario also gives the 
learner the opportunity to become accustomed 
to the virtual world in which they will become 


Figure 2. Observational scenario: Japanese “At the café” (© 2007, CCIR, University of Edinburgh. 


Used with permission.) 
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an active participant in the subsequent speech 
interactive scenarios. The learner listens to the 
dialogue between the characters; access is pro- 
vided to the supplementary materials, if required, 
by pausing the dialogue. 

A series of one-to-one scenarios, entitled in 
the system “Talk to Franco” or “Talk to Ito-san” 
are available. Each one-to-one scenario raises a 
topic which is relevant to the lesson. The learner, 
using headphones and a microphone, is asked a 
number of questions related to the given scene by 
one of the animated characters. These questions 
introduced topics and sentence structures which 
are relevant in the given context and which will 
be useful for their participation in the interac- 
tive scenario. The one-to-one scenarios give the 
learner the opportunity for extended sentence 
practice prior to becoming “immersed” in the 
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interactive scenario. Figure 3 shows the animated 
agent in the one-to-one scenario. 

In cases where the learner is exhibiting dif- 
ficulties, reformulation strategies are used so 
that the learner can receive additional help in 
understanding the question or in formulating 
their response. Recast strategies are used when 
the system detects that the learner has made a 
grammatical error. In addition, recast strategies 
are used where the learner’s response is not given 
in a complete sentence. The program does not 
require, nor specify to the learners that they must 
answer in full sentences. However, the feedback 
given to the learners if they do not answer in full 
sentences is important as it offers additional, rel- 
evant and immediate input to the learners. 

For example, if in the above example, the 
animated agent asks the learner “Nomimono wa 


Figure 3. One-to-one scenario: Japanese “At the café” (© 2007, CCIR, University of Edinburgh. Used 


with permission) 


Nomimono wa nani ga suki desu ka? 
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nani ga suki desu ka?” (“What drinks do you 
like?”’) to which the learner responds “Ocha wa 
suki desu.” (“I like green tea”—which contains 
a particle error “wa” instead of “ga’’) or “ocha” 
(“green tea”—which is not a complete sentence) 
the animated agent would recast the utterance to 
the learner with “4h so desu ka. Anata wa ocha 
ga suki desu.” (“I see. You like green tea.”) In 
this way, the learner receives additional input 
from the system. At the end of each one-to-one 
interaction, the animated agent gives a short 
summary of the dialogue. The communicative 
purpose in the dialogues is that the learner has 
answered the virtual agents’ questions with ap- 
propriate responses (grammatical or not). The 
system does not explicitly state that the learner has 
made an error. However, if the learner has made 
an error, the system gives this implicit feedback 
to the learner. 


The interactive scenario creates an environ- 
mentin which the learner acts as an active dialogue 
participant. In this example, the learner “enters” 
the virtual café and sits at the table with one of 
the animated agents. Figure 4shows the animated 
agent interacting with the learner, seated at the 
table, in the interactive scenario. 

The interactive scenario allows the conse- 
quences of what the learner says to be immedi- 
ately demonstrated through physical actions. For 
example, in the café environment, if the learner 
orders a glass of water from the waiter agent, the 
agent walks to the counter, chooses the appropri- 
ate drink from the available virtual objects, and 
delivers it to the learner “seated” at the table. In 
this way visual cues help to contextualise the 
questions, for example, being handed a menu and 
then asked a question may suggest to the leaner 


Figure 4. Interactive scenario: Italian “At the café” (© 2007, CCIR, University of Edinburgh. Used 


with permission) 
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that the question relates to something related to 
the menu. 

A key element in the design of SPELL is 
that learner input in the dialogue is necessary 
for the dialogue to continue. In the case of such 
transactional dialogues, whatever the learner 
says has consequence for the rest of the dialogue. 
Errors from the learner will either result in the 
agent giving implicit feedback in the form of a 
recast, or will prompt the agent to reformulate 
the initial proposition so that the learner can 
respond again. 

The value of speech recognition technology in 
CALL is a subject of debate. For example, it has 
been found (Derwing, Munro, & Carbonaro, 2000) 
that a commercial speech recognition dictation 
package, which performed acceptably for native 
speakers, did not perform to acceptable levels 
with non-native speakers. However, as has been 
pointed out (Neri, Cucchiarini, & Strik, 2003), 
standard speech recognition packages are not 
designed for non-native speakers. A commercially 
available speaker-independent recogniser was 
used in the SPELL program that has been trained 
on native speaker models only. However, the rec- 
ognition grammars in the SPELL program were 
created specifically for the non-native speaker 
learners of the program. They are programmed 
with grammatical and ungrammatical utterances 
constrained to each stage in the interaction; that 
is, in anticipation of the learner’s response to each 
question posed by the animated agent, a different 
recognition grammar is loaded. The system uses 
individual recognition grammars for each stage, 
thus constraining the possible utterances to the 
given dialogue stage. For a full description of 
the speech recognition grammars used in SPELL 
and further details on the design, see Morton and 
Jack (2005). 
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EVALUATION OF A SPELL 
LESSON: “AT THE CAFE” 


The initial evaluation of the SPELL program took 
the form of a short, standardized procedure in 
which target users interacted with a fully func- 
tional prototype of the system. Researchers were 
present throughout in order that any problems or 
issues arising in the use of the system could be 
observed and recorded. This approach has the 
advantage that the researcher may notice aspects 
of the interaction which the user is unaware of; 
it also allows the researcher to guide the user 
through the session in a pre-designed path so 
that each user who takes part experiences, as 
much as possible, the same procedure. However, 
data collected while the researcher is present 
may be affected by the Observer’s Paradox. The 
Observer’s Paradox (Labov, 1972) refers to the 
situation where the researcher’s presence during 
an interview or observation of subjects’ speech 
patterns may influence the speech behaviour of the 
subjects in the study. In the evaluation described 
here, the Observer’s Paradox is a potential issue 
in the collection of the data since learners may 
not make the same attempts during their inter- 
actions with the system as they would if they 
were alone. However, the benefits of observing 
participants’ use of the system are felt to outweigh 
this drawback. 

All users in the study were asked to com- 
plete the same interactions in the same order. 
By using a standardized procedure in this way, 
general conclusions can be drawn from the data 
about the effectiveness and usability aspects of 
the system. 


Participants 


A total of 52 high school language students took 
part in the evaluation of the program. Lessons 
were built in two target languages, Italian and 
Japanese, and both were evaluated. Eighteen 
students of Japanese and 34 students of Italian 
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took part in the study. The participants came 
from five different Scottish high schools. A total 
of 19 males and 33 females took part; their ages 
ranged from age 13 years to 17 years. 

The evaluations took place at the schools in- 
volved. The researchers met with the students on 
an individual basis to conduct the research session; 
each student involved in the research met with a 
researcher in their own school. For the benefit of 
scheduling within the schools, each session was 
allocated a class period time slot. However, the 
duration of these differed from school to school, 
from 40 minutes to one hour. Working on site had 
drawbacks with regards to the standardization of 
research conditions: different physical spaces used 
in each school, logistics of travelling to various 
sites, set up times, and differing time slots. How- 
ever, in this case of high school participants, there 
were many benefits to working on site such as the 
ability to include a number of participants within 
a short time, minimal disruption to individual 
students within the school day, and the backing of 
teachers who felt it was useful for the students to 
participate. In addition, researching on site within 
the school was perhaps more comforting for the 
participants to be in their own surroundings rather 
than coming to a university “lab.” 


Experimental Procedure 


The evaluation sought to investigate various 
aspects of the prototype program across two 
languages, Italian and Japanese. These are: 


1. The transparency of the user interface 
design; that is, how easy it was for users to 
use the program find their way through the 
program; 

2. User attitudes to using the program; 

3. User attitudes to interacting with the char- 
acters in the lesson; 

4. Users’ behaviour in accessing the supple- 
mentary materials; 


5. User response types and the recognition 
accuracy of the speech recognition compo- 
nent. 


Participants were asked to attempt various 
aspects of the “At the café” lesson. The partici- 
pants first engaged in a navigation task through 
the program which the researcher observed. The 
navigation task was designed in order to highlight 
any possible problems with the user interface. 
Following this, the participant was asked to 
watch the observational scenario, then try two 
of the one-to-one scenarios twice each (here 
referenced as O-O 1 and O-O 2) and then try the 
interactive scenario (INT). The participants were 
informed that they could access other features in 
the program, for example subtitles or vocabulary, 
as they wished. The researcher remained present 
during the program use. After using the program, 
the participants were then asked to complete two 
attitude questionnaires. Finally, the researcher 
engaged the participant in a verbal interview about 
their opinions of using the program. 

Due to limitations of space, the results pre- 
sented in this chapter focus only on users’ attitudes 
towards the program, characters and the speech 
recognition analysis. 


User Attitude Questionnaires 


The questionnaires used to evaluate user attitudes 
to using the program and interacting with the 
characters took the format of a 7-point Likert 
scale questionnaire. This consists of a series of 
statements to which respondents have to select 
a degree of agreement, from strongly agree to 
strongly disagree (see Example 1). 

In the creation of the questionnaires, acquies- 
cence bias (Ostrom, Krosnik, & Sedikides, 1994) 
was taken into consideration. Acquiescence bias is 
the natural tendency forsome respondents to agree 
to an item on a questionnaire possibly as a way of 
seeking the researcher’s approval. To minimise 
this risk, items in the questionnaire were balanced 
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Example 1 
Strongly Agree Slightly Neither Slightly Disagree Strongly 
Agree agree nor Disagree Disagree 
disagree 
Q1 I felt under stress using OQ O QO O QO O 
the program. 


for positive and negative connotations so that a 
positive response would sometimes require the 
respondent to disagree with the statement. 

It has been claimed (Henerson, Morris, & 
Fitz-Gibbon, 1987) that Likert scale question- 
naires are useful for measuring the intensity of the 
participants’ attitudes towards any particular item. 
Using the 7-point scale allows for a more detailed 
investigation of these attitudes than the 5-point 
scale originally proposed by Likert (1932). 

When analysing the results, responses to the 
questionnaire are first given a numerical value 
from 1 to 7; these values then are normalised for 
the polarity of the statements such thata “strongly 
agree” response to a positive statement is given a 
value of 7, whereas a “strongly agree” response to 
a negative statement is given a value of 1. After 
normalisation of the data, the overall attitude for 
each participant can be calculated as a mean of 
all of the scores on the items in the questionnaire. 
These values can then be used to calculate the 
overall attitude for all items in the questionnaire 
across all participants in the study. Additionally, 
mean scores for individual items in the question- 
naire can be obtained for all participants. 

Two attitude questionnaires were designed 
to seek data on interacting with the characters 
and using the program. The usability attributes 
covered affective, engagement and language 
learning issues. The affective issues focussed 
the participants’ levels of anxiety when using 
the program or interacting with the characters. 
It has been suggested (Horwitz, Horwitz, & 
Cope, 1986) that anxiety is more of an issue in 
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listening and speaking activities. Therefore, it is 
particularly important in the investigation of at- 
titudes towards this program to investigate these 
attributes. Users’ feelings of engagement withthe 
program were also collected in order to ascertain 
the degree to which participants enjoyed using 
the program and whether they felt they would 
be happy to use it again. The language learning 
issues related to attitudes towards the interaction 
with the characters and the usefulness of such 
activities for learning. 


RESULTS 
User Attitude 


Due to time restrictions, three participants were 
unable to complete the attitude questionnaires. 
Therefore the results of the attitude questionnaires 
detail data from 49 participants. The mean scores, 
and standard deviation, for each questionnaire 
item relating to interacting with the characters are 
provided in Table 1. It should be noted that both 
positive and negative connotations were used inthe 
questionnaires (described above); however in the 
analysis of the data, each of the statements were 
polarized and assigned anumerical value between 
1 and 7, where 1 represents a negative response 
and 7 a positive response. Therefore, a high overall 
mean score to the item “I felt embarrassed when 
talking to the characters” would indicate that the 
participants did not feel embarrassed. 
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The overall mean scores were high for the 
two language groups; the mean score for the 
Japanese group was 4.56 and 5.17 for the Ital- 
ian group on a 7-point scale. Overall, results 
for both language groups indicated a positive 
attitude towards interacting with the characters. 
Independent samples t-tests were run between 
the two language groups to find any statistically 
significant differences between the two groups. 
The difference between the overall means was 
highly significant (p=.009). 

Items which deal with engagement of interac- 
tion (item 1 - enjoyed talking with the characters 
and item 2 - happy to use again) scored highest 
amongst all the items in the questionnaire. Partici- 
pants expressed a slight preference for speaking 
the target language in class (where the overall 
mean score fell below the median score of 4). 


Participants also expressed a slightly more nega- 
tive attitude towards the recognition performance 
of the system (item 10). These general trends are 
consistent between the two language groups. 

Looking at the items individually, itwas found 
that the Japanese group reported higher levels of 
anxiety than the Italian Group. Items related to 
embarrassment (item 5) and stress (item 6) were 
significantly lower for the Japanese group than for 
the Italian group (p=.017 and p=.003 respectively). 
The item on “feeling in control” when interacting 
with the characters (item 7) was also significantly 
higher for the Italian group (p=.016). Additionally, 
with regards to feeling that they understood what 
the characters said (item 4), the Japanese group 
scored significantly lower than the Italian group 
on this item (p=.011). 


Table 1. Interacting with characters: Usability mean scores on a 7-point scale (N=49) 


Questionnaire Statement Japanese N=16 Italian N=33 
(S.D.) (S.D.) 
1. I enjoyed talking to the characters. 5.75 6.06 
(1.183) (.864) 
2. I would be happy to talk to the characters again. 6.00 6.21 
(.730) (.740) 
3. | always knew how to respond to the characters. 4.69 5.09 
(1.138) (1.234) 
4. I always understood what the characters said. 4.38 5.33 
(.957) (1.291) 
5. I felt embarrassed when talking to the characters. 4.44 5.45 
(1.548) (1.252) 
6. I felt under stress when talking to the characters. 4.63 5.82 
(1.408) (1.185) 
7. 1 felt in control when talking to the characters. 3.88 4.82 
(1.088) (1.467) 
8. I felt frustrated when talking to the characters. 4.63 4.61 
(1.628) (1.749) 
9. I prefer speaking Japanese / Italian in class. 3.38 4.18 
(1.708) (1.570) 
10. I felt that the characters did not understand me. 3.81 4.12 
(1.328) (1.673) 
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The second attitude questionnaire investigated 
users’ attitudes towards using the program. The 
mean scores for each questionnaire item related 
to using the program are provided in Table 2. 
Note that the table contains the wording used in 
the questionnaires. However, during the analysis 
of the data, the items were polarized and values 
(from 1 to 7) assigned to the responses, such that 
high scores to each statement represent a positive 
response. Therefore, a high score to the statement 
“T did not enjoy using the program” indicates that 
the participants did enjoy using the program. 

The overall mean scores were high for the two 
language groups, again indicating a positive at- 
titude towards using the program. The mean score 
for the Japanese group was 5.41 and 6.00 for the 
Italian group; a significant difference (p=.021) 
was found between the two mean scores. Thus, 
although both language groups gave an overall 
positive response towards using the program, the 
Italian group were significantly more positive than 
the Japanese group. 

Again, as with the previous data, those items 
related to engagement issues with the program 
scored highest. The Italian group rated the pro- 
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gram higher than the Japanese group. However, 
the differences were only significant for the af- 
fective items: item 14 - relaxed (p=.037), item 
15 - flustered (p=.022) and item 16 - under stress 
(p=.031). 

Participants experienced varying extents of the 
program, due to time constraints and the ways in 
which they used the program. Some participants 
were unable to complete all the interactions 
specified in the experimental procedure; these 
participants experienced the one-to-one scenarios 
but were unable within the timeframe of the 
evaluation to complete the interactive scenario. 
Attitudes towards the program and interactions 
may have been affected by the extent to which 
participants experienced the program; therefore, 
it was decided to investigate the attitude scores of 
those participants who completed both the one- 
to-one scenarios and the interactive scenario. The 
data of these 43 participants were reanalysed. 

In the analysis of those participants who 
experienced all scenario types, the overall mean 
scores were not significantly different for the two 
language groups; the mean score for the items 
relating to interacting with the characters was 


Table 2. Using the program: Usability mean scores on a 7-point scale (N=49) 


Questionnaire Statement Japanese N=16 Italian N=33 
(S.D.) (S.D.) 
11. I would be happy to use the program again. 6.00 6.36 
(.816) (.603) 
12. I did not enjoy using the program. 6.00 6.27 
(1.317) (.911) 
13. I felt this program was useful for my learning of Japanese / 5.81 5.94 
Italian. (1.167) (1.345) 
14. I felt relaxed using the program. 5.13 6.00 
(1.408) (1.031) 
15. I felt flustered using the program. 4.56 5.52 
(1.459) (1.253) 
16. I felt under stress using the program. 4.94 5.91 
(1.526) (1.042) 
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4.71 for the Japanese group and 5.16 for the Italian 
group. The mean score forthe items relating using 
the program was 5.61 for the Japanese group and 
5.98 for the Italian group. 

The removal of the six participants who did 
not attempt all parts of the lesson is striking. 
Over both questionnaires, the difference between 
the two language groups becomes significant for 
only one individual item: item 10 - feeling that 
the characters understood what they said. For this 
item, the Japanese group (N=12) gave a mean 
score of 3.08 compared with the Italian group’s 
(N=31) mean score of 4.03 (p=.022). 

This difference suggests that the feelings of 
anxiety and stress are alleviated when the par- 
ticipant has had the opportunity to experience 
the “immersive” interaction, which is the most 
contextual of all interactions. However, it should 
be noted that researcher observation suggests 
that for most participants who did not attempt 
the interactive scenario due to time constraints, 
the reason was that they found the one-to-one 
scenarios more difficult and therefore took longer 
to complete the interactions than some of the other 
participants. Had they had the opportunity to also 
complete the interactive scenario, they may still 
have scored the interaction with the characters 
and the program considerably lower. However, in 
looking at a substantial subset of the participants 
who all experienced the same aspects of the les- 
son, there was little difference across the two 
language groups. 

The user attitude results clearly show that 
users’ engagement with the system and interact- 
ing with the characters was high. Statements 
relating to learner anxiety were found to score 
lower than engagement issues, particularly for 
the Japanese group; however, these statements 
were still answered positively (with a score over 
4 on a7 point scale). 


User Response Type 


Participants’ utterances when interacting with 
the system were automatically recorded in the 


program, stored in log files in the system, and 
later transcribed for analysis of response type as 
well as recognition accuracy. The system also 
logged the recognition results at each stage of 
the dialogue. 

Participants’ utterances were categorised into 
four response types. As the interaction between 
characters and user is a series of question and 
answer pairs, the shortest response type that 
facilitates the conversation is “answer only”. 
This often is a one word answer (e.g., sushi), but 
may also be a two word noun compound (e.g., 
miso ramen). The second response type used is 
a “phrase”, which constitutes a number of words 
but does not contain a main verb (e.g., una birra 
per favore). For the purposes of the response 
type analysis, any utterance which contained 
the copula verb was classified as a phrase (e.g., 
sushi desu). The third response type employed 
is a “sentence” which contains a main verb (e.g., 
mi piace il risotto). The fourth response type is 
“verbal non answer”. This final category consti- 
tutes responses where the user has made an ut- 
terance (which triggers the recogniser), but does 
not answer the question. For example, mutterings, 
thinking aloud in English, verbal hesitations and 
non lexical noises (e.g., coughs) are included in 
the “verbal non answer” category. 

Tables 3 and 4 detail the response types of the 
participants in the evaluation. 

As can be seen from the above tables, the par- 
ticipants from the Japanese group gave a higher 
percentage of “answer only” responses than the 
Italian group overall (61.1 percent forthe Japanese 
group compared to 36.0 percent for the Italian 
group). Moreover, 46.1 percent of the Italian 
group’s utterances were full sentence responses 
whereas only 7.8 percent of the Japanese group’s 
utterances were full sentence responses. 

The difference of response types between 
the two language groups may be in part due to 
either the level of linguistic competence which 
the participants hold, or their confidence in us- 
ing the language. The Italian group had received 
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Interaction Participants | Utterances Answer Phrase Sentence Verbal non 
only answer 
O-O 1 18 278 64.7% 18.7% 6.1% 10.4% 
O-O 2 14 84 53.6% 29.8% 14.3% 2.4% 
INT 13 163 58.9% 31.9% 7.4% 1.8% 
TOTAL 525 61.1% 24.6% 7.8% 6.5% 
Table 4. User response type—lItalian 
Interaction Participants | Utterances Answer Phrase Sentence Verbal non 
only answer 
O-O 1 34 474 29.5% 8.4% 55.5% 6.5% 
O-O 2 34 299 29.1% 8.4% 57.5% 5.0% 
INT 31 586 44.7% 21.7% 32.8% 0.9% 
TOTAL 1359 36.0% 14.1% 46.1% 3.8% 


more instruction in the target language and were 
following a prescribed curriculum. The Japanese 
group were studying Japanese in a more informal 
context, as an extra-curricular subject. The Japa- 
nese group also received far less prior instruction 
in the language and this is perhaps reflected in the 
ways in which they responded to the characters. 
However, responding with an “answer only” re- 
sponseis still facilitative to the ongoing dialogue as 
the program is designed in order to allow learners 
to respond as they wish (without forcing them to 
make full sentence responses). 

Interestingly, the Japanese group attempted 
more full sentence and phrase responses in their 
second one-to-one dialogue, O-O 2, than in the 
first, O-O 1, (Table 3). The one-to-one dialogues 
constitute a series of questions posed by one 
animated agent to the user. If the user gives a 
one-word response, the agent will recast this 
response in a full sentence to the learner prior to 
moving on to the next question. The format of the 
one-to-one dialogues may, therefore, encourage 
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the users to give fuller responses as they attempt 
further one-to-one dialogues. 

It also can be seen from Table 4 (Italian) 
that each of the one-to-one dialogues produced 
more full sentence responses than the interactive 
scenario. The interactive scenario represents a 
simulation of a real life dialogue in which the use 
of full sentence responses is less likely. However, 
the opportunity to practice responses in full 
sentences is beneficial for learners and therefore 
the distinction between the one-to-one scenarios, 
which may represent a more traditional tutor- 
student interaction, and the interactive scenario, 
which gives the learnerthe opportunity to practice 
a functional dialogue in a real life simulation, is 
a useful one for learners. 


Speech Recognition Analysis 
The accuracy of the speechrecognition component 


is analysed by comparing the transcriptions of user 
utterances with the output from the recogniser. 
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The utterances are then grouped into in-gram- 
mar and out-of-grammar responses. In-grammar 
responses (IG) have been defined in the grammar 
recognition files (that is, the system developer 
has predicted and programmed the exact word- 
for-word response). Out-of-grammar responses 
(OOG) are utterance strings which have not been 
included in the recognition grammar files. 

Tables 5 and 6 detail the level of in-grammar 
and out-of-grammar responses for the two groups 
of participants in the evaluation. 

Overall there was a slight majority of in- 
grammar utterances across all participants, and 
a slightly higher percentage of utterances which 
were in-grammar for the Italian group than the 
Japanese group. The above tables also show that 
the participants produced more in-grammar 
responses in the interactive scenario than in the 
one-to-one dialogues across both languages. This 
may be due in partto the more transactional nature 
of the interactive dialogue. However, it may also 
be due to the fact that participants try the inter- 
active scenario after the one-to-one dialogues. It 
is possible that this “practice” in the one-to-one 


dialogues helps the learner when they then enter 
the interactive scenario. 

Further analysis of the out-of-grammar re- 
sponses found that many of these responses were 
learner hesitations, self-repairs and repetitions. 
Interaction in the interactive scenario produced 
less of these disfluencies than the one-to-one dia- 
logues and therefore more of the user utterances 
were in-grammar. Additionally, as can be seen 
from the user response data in Tables 3 and 4, 
the interactive scenario produced less non-verbal 
responses than the one-to-one dialogues, which 
impacts on the IG and OOG results. 


In-Grammar Utterances 


The recognition output for the IG utterances was 
analysed both for word-for-word recognition and 
semantic value recognition. As the interaction in 
the dialogues follows a series of question and an- 
swer routines, asemantic value is logged for each 
of the user’s utterances. For example, the question 
from the system “What is your favourite food?” 
might elicit the answer “favourite food sushi.” 


Table 5. In-grammar and out-of-grammar user input—Japanese 


Interaction Utterances IG OOG 
O-O 1 278 42.4% 57.6% 
O-O 2 84 58.3% 41.7% 
INT 163 73.0% 27.0% 
TOTAL 525 54.5% 45.5% 


Table 6. In-grammar and out-of-grammar user input—Italian 


Interaction Utterances IG OOG 
0-0 1 474 52.7% 47.3% 
0-0 2 299 51.5% 48.5% 
INT 586 64.0% 36.0% 
TOTAL 1359 57.3% 42.7% 
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In this response, the word-for-word recognition 
is the string “favourite food sushi;” whereas, the 
semantic value is “sushi.” Ifthe system recognises 
this utterance as “favourite food is sushi,” the 
word-for-word recognition is inaccurate, but the 
semantic value is correct. Tables 7 and 8 detail 
the recognition accuracy for the in-grammar ut- 
terances across the two language groups. 
Overall, 72.4 percentof all IG utterances forthe 
Japanese group and 56.4 percent of all utterances 
for the Italian group had an accurate word-for- 
word recognition. The word-for-word accuracy 
was higher for the Japanese group than for the 
Italian group. This possibly is due to the Japanese 
group giving shorter utterances than the Italian 
group, who on the whole attempted full sentence 
utterances much more frequently than the Japanese 
group. This also is highlighted by results in the 
interactive scenario in both groups. The interactive 
scenario tended to produce shorterresponses from 
the Italian group than the one-to-one scenarios and 
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as can be seen from Table 8, the word-for-word 
accuracy for the interactive scenario was higher 
than the one-to-one scenarios. 

Accurate recognition of the semantic value 
was slightly higher; overall 79.4 percent of IG 
utterances in the Japanese group and 66.2 percent 
of IG utterances in the Italian group had accurate 
recognition of the semantic value. Accurate recog- 
nition of the semantic value allows the dialogue to 
continue effectively between the system and the 
user; the system has “heard” the user’s response 
correctly. However, errors in the users’ responses 
may not be identified accurately. 

The remainder of the utterances were either 
erroneously rejected, ormisrecognised. Rejection 
occurs when the recognition confidence is too low. 
9.8 percent of the Japanese IG utterances and 25.5 
percent of the Italian IG utterances were rejected 
by the system. The effect of asystem reject at any 
stage in the dialogue is a repetition or reformula- 
tion of the initial question giving the user another 
opportunity to respond to the question. 


Table 7. In-grammar recognition accuracy—Japanese 


IG Word-for- Semantic Misrec Reject 
Utterances word value semantic 
0-0 1 118 54.2% 64.4% 18.6% 16.9% 
0-0 2 49 77.6% 85.7% 8.2% 6.1% 
INT 119 88.2% 91.6% 4.2% 4.2% 
TOTAL 286 72.4% 79.4% 10.8% 9.8% 
Table 8. In-grammar recognition accuracy—lItalian 
IG Word-for- Semantic Misrec Reject 
Utterances word value semantic 
0-0 1 250 52.8% 63.2% 12.0% 24.8% 
0-0 2 154 39.6% 50.6% 11.7% 37.7% 
INT 375 65.6% 74.7% 4.3% 21.1% 
TOTAL 779 56.4% 66.2% 8.2% 25.5% 
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Overall, 10.8 percent of Japanese IG utterances 
and 8.2 percent of Italian IG utterances were mis- 
recognised. This is potentially a problematic situ- 
ation as the user answers the system question and 
the system misrecognises this answer for some- 
thing else. Some recurring misrecognitions were 
found in the data. For example, in the Japanese 
system, “kocha” (black tea) and “ocha” (green 
tea) were often misrecognised foreach other. This 
is due to the very similar sounds of these words. 
This problem with these similar sounding words 
affected the first one-to-one dialogue the most, 
where the topic of the dialogue was “drinks.” It 
was felt that in this context it was inappropriate 
to remove one of these drinks, as culturally both 
would be expected within the context. However, 
this issue with similar sounding words should be 
considered in future lesson development, where 
it may be possible to minimise occurrences of 
this type. 


Table 9. Out-of-grammar recognition—Japanese 


Out-of-Grammar Utterances 


Investigation was then carried out on the OOG 
utterances made by participants. Such utterances 
should be rejected by the system, as the system is 
not programmed to “listen” forthem. However, as 
with the IG utterances, some errors were made by 
the system in the recognition of these utterances. 
The system may reject the utterance (correctly), 
misrecognise the semantic value of the utterance, 
or recognise the correct semantic value of the ut- 
terance. Although technically, any recognition of 
an out-of-grammar utterance is a misrecognition, 
these utterances are sometimes mistakenly recog- 
nised ina sucha way as to facilitate the dialogue. 
For example, although the recognition grammars 
are designed to allow for sentence initial hesita- 
tion (for example, “em sushi ga suki desu.”), they 
are not programmed to account for repetitions 
in the user’s speech, mid-sentence disfluencies 
or self-repairs. However, a user utterance that 
contains a self-repair (for example, “sush- sushi 


Table 10. Out-of-grammar recognition—Italian 


OOG Correct Recog Misrec 

Utterances Reject semantic semantic 
O-O 1 160 69.4% 16.3% 14.4% 
O-O 2 35 65.7% 11.4% 22.9% 
INT 44 52.3% 36.4% 11.4% 
TOTAL 239 73.2% 23.8% 17.2% 


OOG Correct Recog Misrec 
Utterances Reject semantic semantic 
O-O 1 224 63.8% 29.5% 6.7% 
O-O 2 145 63.4% 28.3% 8.3% 
INT 211 64.5% 31.3% 4.3% 
TOTAL 580 64.0% 29.8% 6.2% 
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ga suki desu”), which is out-of-grammar, may 
be misrecognised by the system as the similar 
sounding “sushi ga suki desu,” in which case the 
semantic value (sushi) is correct. Tables 9 and 10 
detail the category types for the out-of-grammar 
utterances across the two language groups. 

The majority of OOG utterances were correctly 
rejected by the system. Such utterances included 
utterances in English, non-lexical responses or 
hesitation noises, as well as responses which are 
inappropriate to the question asked. In addition, 
a total of 23.8 percent of OOG utterances in the 
Japanese group and 29.8 percent of OOG utter- 
ances in the Italian group were recognised with 
the correct semantic value. These utterances often 
included short disfluencies in the user’s utterance 
which meant that the utterance was OOG; how- 
ever, the system recognised the utterance with 
the intended semantic value. An example of this 
from the data is the response “mi pref- preferisco 
la pizza” which was recognised as “mi preferisco 
la pizza.” 

Some OOG utterances were misrecognised 
withthe wrong semantic value. These are the most 
problematic as they cause confusion on the user’s 
part. A higher percentage of Japanese utterances 
were misrecognised than the Italian group (17.2 
percent vs. 6.2 percentrespectively). Investigation 
found that the majority of these misrecognitions 
were instances of the kocha — ocha difficulty 
described above. 


DISCUSSION 


The results indicate that this kind of conversa- 
tional dialogue system potentially is very useful 
for language learners, despite misrecognitions by 
the speech recognition component. Analysis of the 
speech recognition component found an overall 
word-for-word accuracy of 72.4 percent for the 
Japanese group and 56.4 percent for the Italian 
group. However, user attitude results indicate a 
high level of engagement and enjoyment with us- 
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ing the system. For example, the mean score for 
the item “I enjoyed talking to the characters” was 
5.75 ona 7-point scale for the Japanese group, and 
6.06 for the Italian group; the mean score for the 
item “I would be happy to use the program again” 
was 6.00 for the Japanese group and 6.36 for the 
Italian group. This is in accordance with research 
into the use of automatic speech recognition in 
CALL applications (Holland, Kaplan, & Sabol, 
1999), which found that despite the limitations of 
the speech recogniser and the misrecognitions it 
generated, end users enjoy the interactions with 
the system and would prefer a speech interactive 
component to be included in the CALL applica- 
tion. 

User response data found that the Japanese 
group tended to give shorter responses than the 
Italian group who attempted full sentences. This 
may, in part, explain the recognition accuracy 
being higher for this group. The Japanese group 
may have opted for shorter responses due to 
their more limited prior exposure to the target 
language than the Italian group. However, the 
Japanese group also scored lower on affective 
issues (embarrassment, and feeling under stress). 
The questionnaires highlight that the Italian group, 
possibly due to their greater exposure to the target 
language, felt more confident with interacting 
with the characters and using the program. This 
may have impacted on the way they responded 
to the characters, attempting fuller responses in 
their interaction with the characters. 

Indeed, it has been suggested (Horwitz et al. 
1986) that there may be a correlation between 
the degree of anxiety felt by the language learner 
and the complexity of the target language output 
which the learner produces. They suggest that 
anxiety “can affect the communication strategies 
students employ in language class. That is, the 
more anxious student tends to avoid attempt- 
ing difficult or personal messages in the target 
language” (p.126). This correlation between re- 
sponse type and anxiety levels was found in the 
study reported here. The Japanese group, whose 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Evaluation of a Speech Interactive CALL System 


attitude results indicated a higher anxiety factor, 
tended to use shorter responses with the charac- 
ters. Some anxiety issues may have been due to 
the researcher being present while the students 
were interacting with the program and these af- 
fective issues may have negatively impacted on 
the desire to try full sentence responses. In real 
usage of sucha program, the learner would not be 
observed using the system, which may alleviate 
some of their feelings of anxiety. 

The recognition accuracy results showed 
that the word-for-word recognition was not ro- 
bust enough to reliably detect learners’ errors. 
The recogniser used in the system is a speaker 
independent recogniser that has been trained 
on native speaker models. In the future, as non- 
native speaker models become available, such 
recognisers should improve and become more 
reliable in language learning applications. Indeed, 
some research is emerging in the area of speech 
recognition systems using non-native speaker 
models (e.g., Morgan & LaRocca, 2004). 

However, from a user perspective, recogni- 
tion errors can be masked by the design of the 
agent interaction. For example, if an utterance 
is erroneously rejected, the system repeats the 
initial question, giving the user another chance 
to respond; if the system does not achieve word- 
for-word recognition, the effect of the recogni- 
tion is the same if the semantic value correctly 
is recognised. In fact, the user would be aware 
of recognition problems only if the system mis- 
recognises the utterance. 

This study has shown that by creating a design 
which accounts for known difficulties with the 
speech recognition technology, engaging speech 
interactive CALL programs can be implemented 
with which users can practice their oral language 
skills within defined dialogue contexts. The ac- 
curacy of word-for-word recognition in the system 
makes it difficult for the system to reliably identify 
users’ grammatical errors. However, as the feed- 
back strategy used in the SPELL program takes 
the form of implicit recasts, and the system also 


is designed to recognise the semantic value of the 
user’s utterance, the effects of misrecognitions 
are minimized, such that the users are not always 
aware of them. Verbalsummaries of the interaction 
are provided to users, and therefore the users are 
exposed to repeated samples of corrected input. 
Crucially, users in the study reported a high level 
of enjoyment in using the program and a strong 
desire to use it again. These results are very en- 
couraging for the use of conversational dialogue 
systems in language learning applications. 
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KEY TERMS 


Animated Agents: Animated agents are 
graphical representations of characters used in 
computer applications, also referred to as Vir- 
tual Agents or Animated Characters. Animated 
agents which are used in conjunction with ASR 
are often referred to as Embodied Conversational 
Agents (ECAs). 
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ASR (Automatic Speech Recognition): A 
technology which allows users of an applica- 
tion to speak utterances in order to interact in or 
control some aspects of the application. Speaker 
dependent recognition systems require the user 
to train the system first with their voice; speaker 
independent systems are trained on large samples 
of user data and can be used without the individual 
user training the recogniser first. 


CALL (Computer Assisted Language 
Learning): An approach in language learning 
in which a computer presents material to the 
learner or where the computer is used as a tool 
to aid language learning. 


Recast: Recasts are a reactive, implicit form 
of corrective feedback, specific to the individual 
learner, whose original meaning is taken and 
restated by the interlocutor with some aspect (pho- 
nological, syntactic, lexical etc) being modified. 


Usability: According to the ISO standard, 
usability of a system is evaluated in terms of ef- 
fectiveness (the extent to which the intended goals 
of use are achieved), efficiency (the resources, 
such as mental effort, that have to be expended in 
order to achieve the intended goals) and satisfac- 
tion (the extent to which the user finds the use of 
the product acceptable) with a particular system 
in a particular context. 
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ABSTRACT 


This chapter reports on a study which evaluates the effect of a language teaching approach called the 
Somatically-Enhanced Approach (Zhang, 2006)in the teaching of Thai to Vietnamese learners in Viet- 
nam. The teaching methodology deals with training students’ pronunciation in Thai from the beginning. 
Innovations include: the using relaxation techniques to relax students; the use of humming, clapping 
and physical gestures to emphasize the rhythm of Thai; the use of a Speech comparison tool (Sptool) 
(Zhang & Newman, 2003) and the provision of all learning materials on CD-ROMs. Results show that 
after 12 face-to-face hours, Vietnamese students who undertook an intensive course in SEA achieved 
the same level of fluency in spoken Thai, in limited contexts, as their fellow students who studied Thai 
for 1 year using the traditional approach. Both quantitative and qualitative results of the study will be 
briefly reported including an evaluation of the Speech comparison tool. 


INTRODUCTION language are not effective in creating proficient 

speakers of that language. This is because many 
Research has shown that traditional methods of the teaching methodologies are designed along 
of teaching pronunciation in learning a foreign the idea of working from a database of errors that 
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learner typically make and then trying to find 
solutions to correct those errors. The teaching 
methodology described in this paper starts from 
the opposite end; it deals with training students’ 
perceptual mechanisms to enable them to have bet- 
ter pronunciation in an L2 from the beginning. 

This chapter consists of the following sections: 
(1) a brief discussion of the theoretical underpin- 
ning that informs Somatically-Enhanced Ap- 
proach (SEA); (2) a brief discussion of SEA ina 
teaching Thai to Vietnamese learners in Vietnam; 
(3) adescription of the speech tool; and (4) results 
of a study involving two groups of beginning 
Thai students at the Faculty of Oriental Studies, 
University of Social Sciences and Humanities, 
Ho Chi Minh City, Vietnam. 


THEORETICAL UNDERPINNING OF 
SEA 


Verbo-Tonalism 


According to acoustic phonetics, a sound in any 
language carries all frequencies from about 50 
Hz to about 16,000 Hz (albeit at various intensi- 
ties). Theoretically, the same sound can be heard 
in many different ways. The ear seems to make a 
“choice” as to what to hear in practice depending 
on the way the ear has been trained. L2 students 
tend to make such choices in the target language 
using what Trubetzkoy (1939) refers to as the 
“mother tongue sieve”: those sounds they are 
familiar with in their mother tongue. In other 
words, it is claimed, each sound has a particular 
“optimal” frequency whichis the frequency band, 
or combination of frequency bands, at which a 
native-speaker best recognizes and perceives the 
sound. Students who experience difficulty with a 
particular foreign language sound are considered 
to not have recognized its optimum frequency 
bands and, consequently, they are unable to re- 
produce the sound correctly. In SEA, translation 


into Vietnamese, romanization in English or tonal 
diacritics are not used in an attempt to prevent the 
activation of the “mother tongue sieve.” 

Building upon this understanding of the nature 
of sound and its part in spoken language, the late 
Petar Guberina (1913-2005), a Croatian psycho- 
linguistic and post-modern scholar, conducted 
research, in the 1950s into speech perception, 
out of which he created the Verbo-tonal method 
(VTM) (Renard, 1975) of rehabilitation for people 
who had severe communication difficulties. 
Underlying the method is the conviction that all 
language use has evolved from spoken language, 
and that speech is a social event. We speak when 
we want to express something or when we react 
to an event and the “meaning” of speech is trans- 
mitted not only by linguistic elements, but also 
by the auditory and visual information present in 
the rhythm, intonation, loudness, tempo, pauses, 
the tension, and gestures of the speaker. Most 
importantly, the auditory and visual information 
in his/her production is a reflection of how he/she 
perceives speech. In other words, changing a 
speaker’s perception of speech will also change 
his/her production of speech. If we correct his/her 
production of speech, we will also have corrected 
his/her perception of speech. 

In addition , the design of the SEA method 
has also benefited from research findings on (i) 
how very young infants use prosodic packaging 
of clausal units to facilitate their memory for 
speech information (Mandel, Jusczyk, & Nelson, 
1994). Hirsh-Pasek, Nelson, Jusczyk, Cassidy, 
and Kennedy (1987) found that infants as young 
as seven months old respond to prosodic markers 
in the input; (ii) a speaker’s natural synchroniza- 
tion of speech and movements (Condon, 1985); 
(iii) therapeutic uses of movements for speech 
and hearing impaired children (Brill, 2003; Di- 
Johnson & Craig, 1971); (iv) Learning through 
multi-modalities is more effective for pronuncia- 
tion training than a single modality (Derwing, 
Munro, & Wiebe, 1998). 
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The Importance of Gesture 


Condon & Ogston’s study (1971) had shown that 
movement is very closely linked with precise 
events in rhythm and intonation. This is known 
as “self synchrony.” Self synchrony is not sim- 
ply confined to hand gestures. Movements of all 
parts of the body are also closely synchronized 
with speech, particularly in terms of vocal stress 
(Halliday, 1970). For instance, spoken English is 
produced in groups of words, typically averaging 
about five in length, where there is only one pri- 
mary vocal stress, conveyed principally through 
changes in pitch, also through changes in loudness 
or rhythm (Bull & Connelly, 1985). 

One of the major problems encountered by FL 
learners is that they attempt to utter sentences in 
the FL while, at the same time, unconsciously 
preserving the set of movements that normally 
functions in theirmother tongue (Gassin, 1990). A 
synchrony of this nature regularly leads to failure 
to reproduce the appropriate stress patterns of the 
FL in question. 


Speech Movement Therapy Based 
on Sense Physiology 


Based onthe system of sense physiology described 
by Steiner (1996), Briill’s (2003) research used 
speech movement to treat two boys suffering 
from mild dyspraxia (Brill, 2003). Steiner (1996) 
argued thatit is important to enable a child to have 
a direct sensory perception of speech sounds, 
phonemes, syllables, and intonation in order for 
him/her to experience the sense of word. As Briill 
pointed out “The sense of word is quite different 
from the sense of hearing, as its function is to 
pick out speech sounds amongst other sounds, 
noises and tones” (Brill, 2003). Contrary to 
most theorists, Steiner (1996) did not see this as 
a cognitive process. He argued that the child was 
able to pick out speech sounds and practice them 
before being able to judge their meaning. 
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Steiner (1996) also noticed the synchronous 
nature of the dialogic conversation between two 
speakers thus acknowledging the need to study 
the effect of the listener on the speaker as well. 
He described the sensory process in the following 
terms: “A speaks and B listens. When A speaks the 
larynx of B vibrates in exact synchrony with A’s 
speaking larynx. B then makes these movements 
of his larynx conscious through the appropriate 
nervous system” (cited in Brill, 2003). 

Stenier’s statement cited above has been vin- 
dicated by William Condon’s work in the field of 
linguistic kinesia. He showed that through inter- 
actional synchrony the speaking of the speaker 
influences directly the body movement of the 
listener: “When A speaks and B listens there exist 
an exact and flowing reaction of movement from 
listener in synchrony with the speaker in 40-50 
milliseconds.”(Condon & Ogston, 1967) In other 
words the voluntary muscles which allow us to 
move become an instrument of reception and reso- 
nance. This is precisely what Condon is arguing 
when he states that the listener’s muscles are the 
perceptive organs for the speaker’s muscle move- 
ments. Steiner coined the new art of movement as 
“eurhythmy.” Briill (2003) provides arudimentary 
description of eurhythmy as follows: 


Each consonant and vowel is expressed by a spe- 
cific gesture of the arms. These gestures cannot 
be executed in a mechanical manner but need 
a “flowing awareness” or an experience of the 
inner quality of the gesture. Steiner states that 
these are not “thought-out” gestures, but that they 
correspond exactly to the air-movement brought 
about when a particular sound is spoken.(Briill, 
2003) 


Oordt (cited in Briill, 2003) has expressed it 
in this way: 


The movement that is invisible but audible in 
the sounding word is to be made visible in the 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Pedagogy Meets Technology in the Somatically-Enhanced Approach 


movement of the whole body. Audible sounds 
transformed into visible movements, into visible 
speech: that is eurhythmy. 


Briill (2003) carried out experiments to test 
the hypothesis “Can the use of movements induce 
and enhance speech?” In the structured therapy 
sessions carried out by Brill, she treated two boys 
suffering from mild dyspraxia who were unable to 
communicate using language. The sessions were 
conducted for half an hour each for two to four 
times a week in a well-sized room which allowed 
space for moving. 

The materials used were simple rhythmical 
poems. They started with the training of gross 
motor movements through walking, clapping to 
rhythms. These steps helped to train the children 
to learn to stop and to differentiate between the 
meaning of “long” and “short.” Then marching was 
used to specifically teaching the boys how to stop 
by putting their feet down decisively. Once these 
gross motor skills were mastered, finger games 
were used to transfer the function performed by 
the previous gross motormovements (suchas stop) 
to finer motor skills (finger movements focused 
particularly on tongue movements). 

Then the rhythmic nature of the verses was 
reinforced by marching to the beat of the rhymes 
and then lastly the eurhythmy gestures represent- 
ing a particular “letter” would be introduced. 
Once these gestures became familiar to the boys, 
they would do them each time they heard the 
corresponding letters in simple verses. Thus the 
perception of differentsounds was sharpened. The 
boys were then asked to make the gesture for the 
target sound each time they heard the sound. 

Briill further notes: “It has been my experience 
that intensive practice of eurhythmy gestures, 
large and small with their arms, feet and fingers, 
eventually helps the childto pronounce the conso- 
nant. Even after years of practice, when the child 
has actually acquired the sounds but suddenly at 
the end of a word hesitates, e.g., book is boo ..., I 
only need to indicate the gesture for “K” and the 


child, relieved by the visual stimulus completes 
the word “book” (Brill, 2003). 

Lastly, after the movement exercises, the 
therapy proceeded to put the sounds practiced 
back in their rhythmic context. 

The two boys followed the normal speech 
development trend of periods of stagnation and a 
sudden leap forward. Inthe fourth year of therapy, 
one of the boys began to use sentences and in the 
sixth year, he began to transfer practiced words 
to everyday situations outside therapy sessions 
and also picked up words that had not been 
practiced. As Brill puts it “this showed that 
the motor-memory for words was beginning to 
work” (Briill, 2003). 

The therapeutic procedure described in Briill’s 
(2003) experiment has much in common with the 
classroom procedure in SEA. Both focus on the 
rhythm of the language rather than the target of 
the treatment. In the case of Briill’s (2003) study, 
the target of the treatment was the consonant dif- 
ficulties in English. In the case of this chapter, it 
was the targeted treatment of Thai prosody. Inboth 
cases, the practice of the rhythm of the language 
was first carried out through marching movement, 
then clapping to train gross motormovement. Then 
gestures were introduced to train the finer motor 
movement. In the case of Briill, such finer motor 
movements and gestures were used to remind 
patients the consonants they were practicing. For 
students learning Thai in SEA, finer motor move- 
ments such as a number of gestures to represent 
stresses or tones were taught to students to remind 
them of those prosodic features of the language. 
In both cases, the last step was to reintegrate the 
gestures and movement and sounds back into the 
rhythmic sentences they started with. 


Learner-Centered Classroom 
Approaches through 
Multi-Modalities 


Learning through multi-modalities is more ef- 
fective for pronunciation training than a single 
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modality. Derwing et al. (1997; 1998) undertook 
a study comparing the implementation of three 
conceptions of pronunciation teaching over a 
relatively long period of time: one taught with a 
segmental focus, a second taught with a global 
focus, and a third that received no specific pro- 
nunciation instruction. In this study, the global 
group received approximately 20 minutes per day 
of instruction for 11 weeks in which the teacher 
focused on features such as speaking rate, intona- 
tion, rhythm, projection, word stress, and sentence 
stress. For instance, the instructor would have the 
students count the number of syllables and the 
number of stresses in each line of the teaching 
materials. The students would tap out the beats 
and use nonsense syllables to focus on rhythm (as 
suggested by Celce-Murcia (1996)). The teacher 
made no attemptto focus on individual consonant 
and vowel sounds. 

The segmental group used language-lab ma- 
terials in conjunction with teacher-led exercises, 
again for approximately 20 minutes per day for 11 
weeks. These exercises were designed to improve 
their productions of individual sounds (Corbett, 
1992). Activities included identification and 
discrimination tasks as well as repetition tasks 
featuring individual sound contrasts. 

Students’ performances in ESL were col- 
lected “before and after” the training. They were 
asked to read sentence-length utterances as well 
as to produce extemporaneous narratives to ap- 
proximate a more “real-life” speaking condition 
(Derwing, 1997). English native speaking (NS) 
listeners evaluated the speech samples by rating 
them for accentedness, comprehensibility and 
fluency in blind tasks. In Derwing et al.’s (1997) 
study, fluency refers to overall tempo and flow 
as opposed to a measure of general proficiency 
(Lennon, 1990). 

The results of the study by Derwing et al. 
(1998) indicated that for sentence reading task, 
the segmental group showed the greatest overall 
improvement in accent after the training process. 
However, after analyzing the extemporaneous 
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narratives produced by the three groups, it was 
found that there was no evidence that the train- 
ing had any effect on the accent scores. Only the 
global group exhibited significant improvement in 
comprehensibility and fluency after the training. 
At first glance, the results on the improvement in 
accent demonstrated by the segmental group might 
suggest that a segmental focus would be margin- 
ally preferable to a global focus. However, the 
results of the extemporaneous narratives showed 
clear evidence of improvement in comprehensibil- 
ity and fluency in the global group only. 

This study conducted by Derwing etal. (1998) 
is informative in that it provided some proof 
that the teaching of suprasegmentals benefits 
the learners in the long run. It also points to the 
importance of skill training. In Derwing’s study 
(1998), the global group teacher did not focus on 
specific consonant or vowel contrasts. Instead she 
had the students actively involved in counting the 
number of syllables and the number of stresses 
in each line of the teaching materials and then 
tapping the beats and the rhythm of the language 
involved. This represents a striking contrast to 
the sedentary nature of the listening tasks the 
students from the segment group were involved 
in. In the segment group, they focused only on 
minimal pair practice. 

It couldbe argued thatitis this active participa- 
tion on the part of the students in the global group 
contributed to the long lasting effect of the training 
on the students’ production in Derwing et al.’s 
study (1998). Another key factor in the success 
of the training might be that two modalities of 
learning had been provided by the global group 
teacher. It can also be argued that the effect of 
the training might not depend on the number of 
prosodic patterns or minimal pairs the students 
had been exposed to. Rather it would probably 
depend on how many modalities did the students 
activate during the training process in order to 
better perceive the language. In the case of the 
global group in Derwing’s study (1998), the stu- 
dents were involved in a multi-modal experience 
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which involved the audio, visual (tapping), move- 
ment, and listening modalities. This experience 
is likely to be more long lasting and profound in 
terms of conditioning the body to the English 
language than just letting learners passively listen 
to minimal pair contrasts. 

In SEA, the movements of the body are es- 
sential in creating memory traces in students. 
Multi-modalities were used in the approach. In 
addition, given the complexity of the various 
processes involved in perception and phonation, 
learning processes must therefore operate at the 
unconscious level. Therefore, an intellectualiza- 
tion of these processes, such as comparing the 
phonetic systems of Thai and Vietnamese, is 
likely to be highly detrimental as it activates the 
“mother-tongue sieve” in the task of learning 
Thai and thus interferes with learners’ percep- 
tion of Thai sounds and prosody. In SEA, the 
traditional cognitive load lightening measure 
such as translation into Vietnamese or English, 
or writing in the Royal Thai General system of 
Transcription are deliberately and intentionally 
were not used at all in teaching Thai in the study 
under discussion. 

Inthe following section, the learning sequence 
with SEA in teaching Thai is described. This 
sequence contains steps which allow students 
to learn kinesthetically, visually, physically, and 
in an auditory manner, and thus encompasses a 
variety of learning modalities. Through these 
steps students learn to see and feel the language. 
Through every aspect of this approach, it is thus 
intended that the language learned is constantly 
associated with a very strong “emotional hook”. 
This emotional component ensures that what is 
learned becomes deeply embedded. Through these 
steps, by observing the teacher’s native speaker 
(NS) behavior, and by perceiving the differences 
between their own and the teacher’s behavior in 
producing Thai, learners are able to respond to 
teacher feedback readily. 


A NEW METHOD OF TEACHING 
THAI PRONUNCIATION TO 
BEGINNERS 


There are five distinctive tones (pitches) in Stan- 
dard Thai. They are: (1) mid level tone (here rep- 
resented with the number 1), for example: khaa1 
(to be lodged in); (2) low level tone (represented 
with the number 2), for example: khaa2 (Galanga, 
an aromatic root);(3) falling tone (represented 
with the number 3), for example: khaa3 (I, slave, 
servant);(4) high level tone (represented with 
the number 4), for example: khaa4 (to sell); (5) 
rising tone (represented with the number 5), for 
example: khaa5 (leg). 

The activities in the lecture sequence were 
concerned with focusing on the rhythm and 
intonation of the language not on consonants or 
vowels or lexical tones. All linguistic items were 
presented in their situational contexts (such as 
“talking about my family”, “shopping” and so on) 
so that students were engaged in meaningful and 
useful language practice. The smallest unit of the 
language being presented is asentence rather than 
individual words or compound words. 


The Lecture Sequence 


Step 1: Theimagery of the “little white cloud” was 
used to relax the students and the teacher. 
This constitutes the “relaxation phase”. This 
sets up arelaxed atmosphere for learning for 
the rest of the lesson. 

Step 2: Students and the teacher walk around in 
circles and hum along to the rhythm of the 
sentences without vowels and consonants 
(five times). This is used to highlight the 
intonation and rhythm of Thai. It is im- 
perative that in this step, the teacher does 
not start by modeling or reciting the target 
sentence as any such modeling inevitably 
causes students to repeat after the teacher. 
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The idea behind this step is to focus on the 
melody of the sentence without the interfer- 
ence of consonants and vowels. It is also to 
encourage the creation of mystery so that 
students’ curiosity is aroused. This delayed 
exposure to consonants and vowels shifts 
students’ attention to other often neglected 
aspects of the language such as rhythm and 
intonation. 

Step 3: The teacher claps to the rhythm and the 
beat of the language and then ask students 
to follow. This allows students to experience 
the rhythm of the sentence and observe dif- 
ferent groupings of the words in a sentence. 
This also enables them to observe the key 
words in a sentence and realize that not all 
words are of equal value and that in making 
oneself understood, one only needs to get 
the key words right to be understood. 

Step 4: The teacher walks about with feet coming 
down on every syllable. This is to get the 
body used to producing a tone such as the 
tense downward tone (the falling tone). The 
teacher also raises or stretches upwards as 
though attempting to touch the ceiling. This 
allows students to experience the tenseness 
of the body when producing the rising tone. 
Students are then instructed to follow the 
teacher to perform the same gestures. 


Students are also instructed to adopt a forward 
lumping of the shoulders for 1st and 2nd tones 
in Thai as the production of these tones need a 
relaxed posture. This is particularly important 
when the teacher detects that after the humming 
and clapping students still fail to perceive the 
rhythm and melody of the sentences correctly. 
Gesturing provides students further ways of 
manipulating the body tension to achieve certain 
rhythmic structures. 


Step 5: Mouthing the words: In this step, the 
teacher instructs students by saying “Con- 
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tinuing with the movements, now mouth 
the sentences while I say them out loud” 
(Step 5). For the first time in the learning 
sequence, so far, students were hearing an 
intelligible sentence. They were asked notto 
say anything but merely to mouth the words. 
Mouthing the words gives students the op- 
portunity to practice the articulation of the 
sounds of the words without, in fact, placing 
them on an intonational background actu- 
ally produced themselves. This technique 
should lead to a reduction in the number of 
articulation errors. 

Step 6-7: Adding words to the intonation patterns: 
The teacher then says “Now repeat after 
me, and then add words to the intonation.” 
This again is done for five times (Step 6). 
The teacher then instructs each individual to 
repeat the sentence by themselves in chorus; 
checking that each student is reproducing 
the sentence correctly (Step 7). 


Steps 2-5 isolate each element of articulation, 
for example, humming, clapping, and mouthing 
before restoring them to a normal context (steps 
6-7). This procedure has the further advantage 
of eliminating as many difficulties as possible 
in terms of comprehension of the sentence. 
Consequently, by the time students are actually 
asked to repeat a full sentence, they will have 
practiced each of its constituent elements many 
times. They will look forward to achieving suc- 
cess in the next step of the process which will 
follow naturally and which should present little 
additional difficulty. 

The rest of the lecture was involved in ac- 
tivities that further highlighted the melody of 
the sentences involved. Throughout the learn- 
ing sequence, translation and writing down the 
sentences are not needed until the last moment. 
By the time students come to write down the 
meaning, they will have already internalized 
and memorized the melody of the sentences. The 
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activities in the lecture sequence offer students 
a range of physical ways for remembering the 
Thai sentences learned beyond the set contact 
hours each week. These measures set up a series 
of learning steps that can be used for self-access 
learning at home. 


Course Materials 


The course materials used in SEA consisted of 
a printed textbook, a course data CD-ROM, an 
Audio CD-ROM and a speech processing tool. 
Eachnew vocabulary item, new sentence or phrase 
in the teaching materials is linked to a sound file. 
The course data CD-ROM also contains teach- 
ing materials in html format; all the associated 
sound files, the speech tool (Sptool). An audio 
CD-ROM of the sound files is also provided with 
the course materials. 


The Role of the Speech Processing 
Tool 


In the process of language learning, especially 
in a formal foreign language environment such 
as a university Thai class in Vietnam, students 
often feel that they lack the opportunities to check 
whether they can be understood by anative speaker 
of the target language. Usually the only feedback a 
student gets is from their language teachers whom 
he or she sees for only a few hours a week. 

Just like traditional pronunciation training, 
these learning environments with built-in Com- 
puter-Assisted Pronunciation Training (CAPT) 
built in are only effective if they have been de- 
signed according to sound pedagogical guidelines. 
At the moment few of the available systems meet 
such requirements (Pennington, 1999). One of 
the most valuable roles for CAPT systems with 
built-in ASR technology is to provide accurate 
and automatic feedback. Getting good quality 
feedback is an important aspect of language 
learning (and learning in general). 


Feedback takes place in a language teaching 
classroom on a daily basis. In a communicative 
classroom, students are frequently called upon or 
volunteer to try out a new sentence, conversation 
or structures. He or she then receives feedback 
from the teacher or his or her fellow classmates 
almost instantly in many ways. In the classroom, 
many channels are used for communicating 
feedback; for example, through error correction 
and other channels such as body language, non- 
verbal behavior, facial expressions, gestures, tone 
of voice, and so on. Such feedback is usually 
instantaneous, involuntary (from the feedback 
provider) and disappears very quickly from the 
memory of everyone involved. So in a traditional 
classroom, while we receive a huge amount of 
feedback on our production, the feedback received 
seldom becomes guidance for long term learning 
in areal, face-to-face communicative interaction 
outside the classroom. This is due to two reasons. 
Firstly, this kind of the feedback offered in the 
classroom clearly has minimal effect on student 
learning. Secondly, understanding what the 
feedback contains and how to act on it are not as 
easy as it Seems. 

The advent of computer technology in language 
learning has addeda very interesting dimension to 
therole of providing feedback. Computer technol- 
ogy can provide an environment in which certain 
memory traces that work for a particular learner 
can stay longer within students’ consciousness or 
sometimes unconsciousness. In a real-life situ- 
ation, such memory traces can be called up to 
help facilitate the communication involved. The 
advantages of feedback offered by a computer 
are that the feedback is constant; can be repeated 
over and over again; and allows students to control 
their own learning. 

The design of CALL tools for providing feed- 
back has to depend on the theoretical framework 
that conceptualizes the tools. For example, in a 
Speech-Recognition-Based pronunciation train- 
ing experiment conducted by Tomokiyo, Le Wang, 
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& Eskenazi (2000.), the feedback offered still 
follows the model of offering explanation using 
diagrams of articulatory position and minimal 
pair practice. Thus the criticisms that are put for- 
ward against the various approaches of teaching 
pronunciation in language teaching are equally 
pertinent here as well. 

At the moment, ASR-based CAPT systems 
such as the one presented in Tell Me More Chi- 
nese (Auralog, 2004) do not tell the learner what 
they should do to interpret the feedback. There- 
fore, after repeating the highlighted portion of 
the sentence many times and perhaps with each 
attempt getting more and more correct, learners 
cannot get a concrete idea on how to transfer the 
learning received during these attempts with this 
particular sentence, to future attempts with other 
sentences outside the domain of the 200 sentences 
prescribed by the system. Learners, for example, 
will not know how to manipulate their body 
posture, movements or even their articulatory 
systems to ensure that their future attempts are 
successful. In a sense, when the learner repeats 
the same sentence next time, again it will be a 
trial and error process as they cannot recall what 
they learned last time they used the system. In 
other words, the learners are doing the exercises 
but they are not learning. 

In SEA, an audiovisual feedback tool (Sptool) 
(Zhang & Newman, 2003) was created to allow 
the incorporation of a visual representation of 
student’s production that can be compared to the 
speech of a native speaker. It was designed to give 
learners the opportunity to listen and perceive 
differently, thus increasing the probability of 
changing the ways they both hear and produce. 
There are three reasons why in the present study 
instead of adopting an ASR-based CAPT system 
to enhance learning, Sptool (Zhang & Newman, 
2003) was used with the experimental group of 
students. As Neri, Cucchiarini, and Strik (2003) 
pointed out that two main reasons make these 
CAPT systems ineffective: (1) the simultaneous 
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display of the incoming learner’s utterance and the 
model utterance wrongly suggests that the student 
should ultimately aim at producing an utterance 
whose acoustic representation closely corresponds 
to that of the model. In fact, even though two 
utterances have very different waveforms, they 
may both be very well pronounced according 
to a native speaker. (2) Secondly, these kinds of 
displays are not easily interpreted by students, 
because they provide too much information on 
the student speech’s amplitude, pitch, duration 
which inhibits the learners from being able to 
pick up the most salient aspects of the acoustic 
signal. A third reason is that of user friendliness. 
CAPT systems, such as Praat (Boersma & Ween- 
ink, 2003), are too specialized for student use as 
they were originally created for phoneticians for 
specialized phonetic analysis. 

By contrast to other ASR-based CAPT system, 
the speechanalysis tool Sptool (Zhang & Newman, 
2003) is designed to offer feedback that is non- 
judgmental, that is, without ascoring system, and 
allows students to explore and reflect during the 
process of learning, and not just at the end of the 
learning process. Even without a scoring system, 
students should be motivated to use this tool as 
they can listen to the language and reflect on it by 
observing visually the differences between their 
production and the NS model. In addition to this 
resource, students are also taught physical ways of 
enhancing memory traces of the language learned 
inthe classroom context. In this way, students can 
act upon their perception and change the process 
of production in their private study. In addition, 
the design of the Sptool is to measure the pitch 
curves of sentences in foreign language. This 
means the Sptool is capable of showing the pitch 
curves as well as length and loudness (correlates 
of Thai) of utterances in Thai speech through the 
display of the height and the length of the words 
within utterances. The height and length of the 
curves also correspond to the articulatory gestures 
needed to produce rhythmic structure of sentences 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Pedagogy Meets Technology in the Somatically-Enhanced Approach 


used in the lecture sequence. Combined with the 
articulatory gestures it is hypothesized that this 
will make the feedback long lasting. 

All the written teaching materials on the data 
CD-ROM were linked to sound files and passed 
through the Sptool. Once passed through the Sp- 
tool, the learner can listen to the teacher’s model 
pronunciation by clicking on the “teacher” icon. 
With one click, he or she can hear the model sen- 
tence and see the pitch curve of the model sentence 
displayed on the screen. If the learner wants to 
hear a smaller chunk of the sentence, then he or 
she can select the bit of the curve by dragging the 
cursor over the portion he or she wants to hear. 
After listening to the sentence numerous times, 
the learner can decide whether he or she want to 
record his/her own production. 

Some of the activities in the lecture sequence 
can be duplicated in different forms through the 
use of the Sptool. While the classroom sequence 
is more or less teacher driven and physical, the 
Sptool allows the lecture sequence to be experi- 
enced differently. 

In the following sample sentence, “dilchan4 
chUU3...” (Lam .....) “dil chan4 chuu3...?” is a 
key string of words and the curve clearly shows 
that the “chU U3” is clearly longer than the rest. 
This information is extremely important when 
training students to accept that the ultimate aim 


of producing an utterance which is acceptable by 
native speakers is NOT to produce an utterance 
whose acoustic representation is an exact match 
or even closely corresponds to that of the model. 
It is vital to impress upon the students that the 
importance in producing a comprehensible sen- 
tence in Thai is to be able to produce the key parts 
of the utterance correctly. 

The use of the Sptool encourages students 
to reflect on and explore in the process of learn- 
ing. Furthermore, being able to experience each 
sentence repeatedly through the Sptool creates 
an environment in which students can totally im- 
merse themselves consciously and unconsciously 
in the language. 


THE STUDY 
Subjects in the Study 


Fourteen students from 2005 who studied in the 
mainstream year long Thai course at the Faculty 
of Oriental Studies, University of Social Sciences 
and Humanities, Ho Chi Minh City, Vietnam, 
constituted the Control Group (CG).14 students 
from the same institution, who were recruited for 
anintensive Thai course conducted in September, 
2006 over a three-week period for 12 face-to-face 


Figure 1. Picture of the Sptool showing the sample sentence: Iam.... (dil chan4 chuu3...?) 


Teacher 


Stuciont 
ween | Si pee | 


= 
Boo PS SS se Ootce ssi 


Key: 1=first tone; 4=fourth tone; 3= third tone. 
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contact hours, constituted the Experimental Group 
(EG). Only 10 students sat for the end of course 
speaking test. Students from both groups were 
evaluated with respect to their performance in 
producing intelligible spoken Thai in October 
2006. All of the students speak Vietnamese as 
their first language and were total beginners of 
the Thai language. 


Procedure 


Students in the CG were not taught with SEA and 
did not have the computer support but they had 
been studying Thai for 1 year in the mainstream 
course which covered the four macro-skills of 
speaking, listening, reading and writing. Students 
in the EG, on the other hand, was taught by SEA 
covering only speaking and listening skills. They 
were also provided with data and audio CD-ROMs 
which include aspeech processing tool which they 
could use at their own leisure to listen to course 
materials spoken by native speakers of Thai. 

By the end of the experiment, students in EG 
had completed 12 face to face contact hours over 
three weeks. The data from EG was compared 
with data from CG using the subject materials 
covering the same conversational topics through 
the same oral and written testing mechanisms. 
See Appendix 1. A set up using Sony microphone 
plugged into a Dell laptop computer using Cooledit 
2000 (Syntrillium, 2002) to make the recording. 
In the next section, the results the project will 
be reported. 


RESULTS 


In this section, the results of a perceptual test, 
quality of the language and an open-ended 
questionnaire are reported. The perceptual test 
involved native 11 Thai native speaker markers 
(four are language teachers) from the Faculty 
of Humanities and Social Sciences, KhonKaen 
University, Thailand. The researcher was not 
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one of the native speaking markers. All markers 
participated in the current perceptual test on a 
voluntary basis. Materials to be marked were 
spoken conversations from both the CG and EG 
of Vietnamese speaking students. The markers 
did not know which group each student belonged 
to at the time of marking. The number of samples 
marked was 24. 

The statistical analyses were performed on 
the spoken conversations performed by both CG 
and EG using the Analysis Toolpak in the Excel 
packageand SPSS statistical package. The critical 
significance level was set at p<0.05 throughout 
the study. All oral production data from the 24 
subjects (both CG and EG) were analyzed. A two 
tail T-Test for two samples of equal variance were 
used to analyze the various characteristics of the 
conversations spoken by all the subjects involved 
in this study. 


Results of the Listening Test Marked 
by Native Speakers 


Subjective perceptual results of the perceptual 
test by native speakers confirm that the students 
taught by SEA from the EG performed equally 
well as the students in CG who were not taught 
by SEA and had been studying Thai for over one 
year. Students in the EG achieved an average rat- 
ing of 10.01 out of 15 with a standard deviation of 
0.76 compared to the CG’s average rating of 9.76 
out of 15 with a standard deviation of 0.76. The 
difference in the means of the perceptual rating 
scores given by the markers was not statistically 
significant at p<0.05 level (p=0.184), t=-1.33, df 
(22), p<0.05 with p=0.184. This means EG stu- 
dents performed equally well as the students in 
CG despite learning the language in a period of 
12 face-to-face contact hours over three weeks. 
In order to ascertain the reliability of indepen- 
dent Thai native speakers’ ratings, an inter-rater 
reliability was calculated. The level of agreement 
in the ratings reached by the 11 native speakers 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Pedagogy Meets Technology in the Somatically-Enhanced Approach 


Table 1. T-test analysis for dependent samples illustrating the relation between EG and CG and the 
dependent sample (mean perceptual rating scores given by native speaker judges) 


Groups N Means SD 
CG(n=14) 14 9.76 0.76 
EG (n=10) 10 10.014 0.76 


was reasonably high as indicated by an inter-rater 
reliability score of 0.782. 


Quality of the Conversations 


The quality of the conversations produced by both 
groups was also measured by Mean Length of 
Utterances (MLU). The quality of the utterances 
was Slightly different from similar data collected 
from the CG and EG. In the CG (n=14), students 
produced an average of 61.4 words with an aver- 
age sentence length of 9.2 words per sentence. 
Students’ in EG (n=10) produced an average of 41 
words per person and sentences with an average 
mean length of utterances (MLU) of eight words 
persentence. The differences between the average 
length of utterances produced is not statistically 
significant with p=0.12. 

However, students in CG produced many more 
fillers such as “ums” and “ahs” than students in 
EG. On average, students in CG produced 29.9 
fillers and students in EG produced 8.4. The dif- 
ferences between the number of fillers produced 
is statistically significant with p=0.0068. The 
positions of the fillers are also interesting. The 
fillers were analyzed according to the position of 
their occurrences. Fillers occurred in the follow- 
ing ten positions: 


1 = between subject and verb 
2 = at the end of a sentence 
3 = between noun and an adjective 


4 = between verb and object 

5 = before prepositional phrase 

6 = at the beginning of a sentence 

7 = between verb and adverb 

8 = before conjunction 

9 = at the beginning of a phrase 

10 = at the beginning of words (between words) 


It can be seen that students in CG used fillers 
very frequently in every position in the conversa- 
tion (see Table 2) whereas students in EG used far 
fewer fillers and used fillers mainly at the begin- 
ning of asentence (position 6) or phrase (position 
9) (see Table 3). Four students out of 10 in the EG 
used no fillers or only one filler throughout the five 
conversations. The results in Table 3 suggest that 
students in the EG had better recall of vocabulary 
and phrases (more fluent) despite the short period 
of instruction time. This result is confirmed by 
their questionnaire data in which they claimed 
that SEA makes it: 


. easy to understand and remember and it is 
embedded in my head; and; 

. that humming is good for getting acquainted 
with new vocabulary; 

. easy to remember new vocabulary; and 

. that with this method of teaching I can 
remember the language easily and I can 
remember all the vocabularies for a long 
time. 
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Table 2. Distribution of fillers in 10 different positions produced by students in CG 


peeve PP Pe 
fillers 
student 1 1 
mem 
student 
Ea a 
ce oe ee Pe ee ee 
3 
student 1 5 2 
amy or F FP oe Pe ee 
student | 4 1 1 5 2 13 
eevee 
student 2 1 2 7 3 2 17 
owt FF Pe PP fe ee Pe ey? 
meee ee ee PP 
7 
student 1 1 20 2 2 3 2 39 
Ea a a 
student | 4 2 2 25 5 2 11 57 
ow te PP ee Pe ee 
oy Ee Pe i ee Ey | 
10 
student 1 1 2 12 3 1 20 
mew ye ee ee 
student | 3 3 1 25 2; 4 
ew PP Pee Pe Pe 
student | 4 1 i 4 2 16 5 42 
ow ee ee ee Pe Pe PP fF 
ew? oe ee ee Pe ee 
14 


Key: 1 = between subject and verb 


2 = at the end of a sentence 

3 = between noun and an adjective 

4 = between verb and object 

5 = before prepositional phrase 

6 = at the beginning of a sentence 

7 = between verb and adverb 

8 = before conjunction 

9 = at the beginning of a phrase 

10 = at the beginning of words (between words 
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Table 3. Distribution of fillers in different positions produced by the students in EG 


Students Hi 2 3 4 5 7 10 Total 
fillers 


Key: 1 = between subject and verb 

2 = at the end of a sentence 

3 = between noun and an adjective 

4 = between verb and object 

5 = before prepositional phrase 

6 = at the beginning of a sentence 

7 = between verb and adverb 

8 = before conjunction 

9 = at the beginning of a phrase 

10 = at the beginning of words (between words) 


Results of the Listening 
Comprehension Tests 


At the end of the intensive course, both EG and 
CG are given the same listening comprehension 
test to ascertain their achievement in their lis- 


tening ability. Students in CG achieved a score 
of 20.58 (SD: 2.95) out of 30 marks on average 
and the students in EG achieved a lower score of 
15.88 (SD: 3.99) out of 30 marks (see Table 4). The 
differences between the means of their listening 
comprehension tests are statistically significant at 


Table 4. T-test for the listening comprehension test marks obtained from CG and EG 


Groups N Means (out of 30 marks) Standard Deviation (SD) 
CG 14 20.58 2.95 
EG 10 15.88 3.99 
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p< 0.05 with p=0.014. Students in CG have been 
learning Thai for a year and in their course, apart 
from the listening and speaking skills, they also 
covered reading and writing skills. Therefore, it 
is expected that they had longer exposure to Thai 
and more vocabulary and grammar under their 
disposal than students in the EG group. 


Questionnaire Results 


At the end of the intensive course taught using 
SEA, students in EG were asked to fill in an 
open-ended questionnaire to gauge their attitudes 
towards SEA.14 students completed the question- 
naire eventhough only 10 completed the speaking 


Table 5. Feedback from the questionnaires of students in EG towards SEA and computer tools 


Easy to understand and remember and it is embedded in my head. 


Easy to learn foreign language. 


Learn tones in Thai easier. 


Humming is good for getting acquainted with new vocabulary. 


Humming made me feel comfortable in learning a new language. 


Easy to remember new vocabulary. 
Mouthing helps us to pronounce words correctly. 


approach a new language. 


This method of teaching is a way that students are active learners not passive, and it is a good way to 


foreign language. 


This method of teaching is a new way which is interesting and with this way I can see that it is useful to learn 


This method of teaching generates a good relationship between the teacher and students. 


With this method of teaching, students have to move around so, they did not get bored in the classroom. 
The class was joyful, pleasant, and lively. I felt comfortable to talk with the teacher. 


Listening to the CDs, we can hear the normal rate of native speakers of Thai language. 


a long time. 


With this method of teaching I can remember the language easily and I can remember all the vocabularies for 


Even though we have just three weeks to learn Thai language we can learn a lot. 


time. 


Having a chance to pronounce words or sentences repeatedly in class made me remember them for a long 


The atmosphere in the classroom was very pleasant and comfortable. 


With this method of teaching it is easy to remember the intonation of Thai language. 


Moving our body is a great help in remembering. 


With clapping I can remember the correct intonation in Thai. 


All activities in classroom arouse us to learn and things that we learn are embedded in our head. 


which one is the answer. 


Correct pronunciation can help me to learn how to differentiate which one is interrogative sentence and 


Relaxation in the beginning of the class is a good way to relax. 


This teaching method is suitable for Thai language because tones are very important in Thai language. 


I felt very happy when I was in the classroom. 


Mouthing helps me with the correct pronunciation. 


Learning by this way made me feel more confident to communicate in Thai. 
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test. The four extra students wanted to provide 
feedback on the teaching approach. The students 
felt very positive towards SEA as indicated by 
their comments in Table 5. 

Asshownin Table 5, all fourteen students found 
the low affective filter in the relaxed, friendly 
atmosphere with a lot of movement helped them 
remember the language as this approach “em- 
beds” the language into their heads through the 
body. This approach was particularly helpful in 
the retention of vocabulary. They also found the 
CD-ROMs and Sptool very helpful as they can 
“hear the normal rate of native speakers of Thai 
language” (from the questionnaire responses) at 
home. As one learner put it “This method of teach- 
ing is a way that students are active learners not 
passive, and it is a good way to approach a new 
language” (from the questionnaire responses). 


DISCUSSIONS AND CONCLUSION 
The findings of the study are very encouraging: 


1. Despite covering similar language in 12 
hours over three weeks, students taught by 
SEA performed equally well in speaking 
tests as rated by native speakers of Thai; 

2. The quality of Thai students in EG is as 
good as those produced by students in CG 
who have been learning Thai for a year; 

3. Students in EG seem to be highly motivated 
to learn through SEA as demonstrated by 
the questionnaire responses. 


The results flowing from this project should 
be treated with some caution. This is because: (1) 
the students in CG and EG were not randomly 
chosen; they were self-selected based on their 
interest in learning Thai; (2) the students in CG 
didnotrepresenta true control group as the length 
of study thus exposure to Thai is much longer 
than students in the EG; (3) students in CG were 


taught the four macro-skills whereas students 
in EG only covered the speaking and listening 
skills; (4) since this was not comparison type of 
empirical study, it was difficult to attribute the 
achievement made by students in EG to either 
SEA or Sptool or the CD-ROMs. It is possible 
that a combination of all three contributed to the 
achievement of the students in EG. The condi- 
tions under which the students were recruited to 
the project were not under our control. A larger- 
scale study, ideally using random assignment to 
conditions would be the only way to evaluate the 
efficacy of SEA. 

The findings of this study confirm the find- 
ings of the application of SEA in the teaching 
of Mandarin to English L2 learners outlined in 
Zhang’s study (Zhang, 2006). The rate of learning 
Mandarin was certainly sped up by the application 
of SEA. This certainly is true of this project. 

This study, however, shows that the combina- 
tion of a theoretically sound teaching approach 
and computer technology such as the Sptool and 
CD-ROMs can create a motivating language 
learning environment. The technological ele- 
ments such as the sound, video, text files, and 
Sptool complement the non-technology driven 
elements suchas one’s body, voice, movement and 
gesture available to every student. Furthermore, 
the frequency of interaction in class and ease of 
access afforded by the Sptool and sound files 
were extremely motivating for students. Indeed 
through the application of SEA, it is possible to 
create an effective learning environment in which 
physical, biological and technological means have 
acted in concert to motivate students and convert 
learning in the classroom to real life use of L2 in 
realistic situations. 


ACKNOWLEDGMENT 


The authors wish to acknowledge the support of 
a grant from “Centre for Research on Plurality 


255 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Pedagogy Meets Technology in the Somatically-Enhanced Approach 


in the Mekong Region” (CERP), KhonKaen Uni- 
versity Thailand and the University of Canberra, 
Australia. 


REFERENCES 


Auralog. Tell Me More (Chinese) (Version PC or 
compatible, windows XP). (2004). France: Auralog 
S.A. http:// http:/www.auralog.com 


Boersma, P. & Weenink, D. (2003). Praat [Speech 
Analysis]. Institute of Phonetic Sciences. Univer- 
sity of Amsterdam: Institute of Phonetic Sciences, 
University of Amsterdam. 


Brill, A. (2003). The acquisition of speechthrough 
speech-movement therapy: An exploratory study. 
The British Journal of Developmental Disabilities, 
49, Part 1(96), 59-65. 


Bull, P. E., & Connelly, G. (1985). Body movement 
and emphasis in speech. Journal of Nonverbal 
Behavior, 9, 169-187. 


Celce-Murcia, M., Brinton, D. M., & Goodwin, 
J. M. (1996). Teaching pronunciation: A refer- 
ence for teachers of English to speakers of other 
languages. Cambridge: Cambridge University 
Press. 


Condon, W. S., & Ogston, W. D. (1967). A seg- 
mentation of behavior. Journal of Psychiastric 
Research, 5, 221-235. 


Condon, W.S., & Ogston, W. D. (1971). Speech and 
body motion synchrony of the speaker hearer. In 
D. L. Horton & J. J. Jenkins (Eds.), Perception of 
language. Columbus Ohio: Charles E. Merrill. 


Corbett, K. (1992). Better English pronunciation 
for immigrants: Consonants and vowel correc- 
tions. Calgary, AB: Coralex Publisher. 


Derwing, T. M, Munro, M. J., & Wiebe, G. E. 
(1997). Pronunciation instruction for fossilized 
learners: Can it help? Applied Language Learn- 
ing, 8, 185-203. 


256 


Derwing, T. M, Munro, M. J, & Wiebe, G. E. 
(1998). Evidence in favor of a broad framework 
for pronunciation instruction. Language Learn- 
ing, 48(3), 393-410. 


DiJohnson, A., & Craig, W. N. (1971). An inves- 
tigation of the verbotonal method with preschool 
deaf children: A preliminary interim report. 
Pensylvania Department of Education. 


Gassin, J. (1990). The notion of synchrony in 
second language learning. In H. N. John Gib- 
bons; M.A.K. Halliday (Ed.), Learning, keeping 
and using language: Selected papers from the 
Eight World Congress of Applied Linguistics. 
Amsterdam/Philadelphia: John Benjamins Pub- 
lication Co. 


Halliday, M. A. K. (1970). A course in spoken 
English: Intonation. London: Oxford University 
Press. 


Hirsh-Pasek, K., Nelson, D. G., Kemler, P. W., 
Jusczyk, C., Wright, K., Druss, B., & Kennedy, 
L. (1987). Clauses are perceptual units for young 
infants. Cognition, 26, 269-286. 


Lennon, P. (1990). Investigating fluency in EFL: 
A quantitative approach. Language Learning, 
40, 387-417. 


Mandel, D. R., Jusczyk, P. W., & Nelson, D. G. 
K. (1994). Does sentential prosody help infants 
to organize and remember speech information? 
Cognition, 53, 155-180. 


Neri, A., Cucchiarini, C., & Strik, H. (2003). Au- 
tomatic speech recognition for second language 
learning: How and why it actually works. Paper 
presented at the Proceedings of 15th ICPhS, 
Barcelona, Spain. 


Pennington, M. C. (1999). Computer-aided 
pronunciation pedagogy: Promise, limitations, 
directions. Computer Assisted Language Learn- 
ing, 12, 427-440. 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Pedagogy Meets Technology in the Somatically-Enhanced Approach 


Renard, R. (1975). Introduction to the verbo-tonal 
method of phonetic correction (B. Morris, Trans.). 
Paris: Didier. 


Steiner, R. (1996). Foundations of human expe- 
rience (R. Lathe & N. Whittaker, Trans.). USA: 
Anthroposophic Press. 


Syntrillium Cooledit (2000). Syntrillium soft- 
ware. 


Tomokiyo, L. M., Le Wang, & Eskenazi, M. 
(2000.). An empirical study of the effectiveness 
of speech-recognition-based pronunciation tutor- 
ing. Paper presented at the Proceedings of ICSLP 
(International Conference on Spoken Language 
Processing), Beijing. 


Trubetzkoy, N.S. (1939). Principles of Phonology 
(Grundzuge de Phonologie, Travaux du cercle 
linguistique de Prague.) (C. Baltaxe, Trans. 1969 
ed.). University of California Press. 


Zhang, F. (2006). The teaching of Mandarin 
prosody: A somatically-enhanced approach for 
second language learners. Unpublished PhD, 
University of Canberra, Canberra: Australia. 


Zhang, F, & Newman, D. [Speech Tool] (2003). 
Canberra, Australia: University of Canberra, 
Australia. 


KEY TERMS 


Accentedness: Refers to the extent to which 
a listener judges L2 speech that differs from the 
native speaker norm. 


Acoustic Phonetics: Deals with the trans- 
mission of speech sounds through the air. When 
a speech sound is produced it causes minor air 
disturbances (sound waves). Various instruments 
are used to measure the characteristics of these 
sound waves. 


ASR: Automatic speech recognition is the 
process of converting aspeech signal to asequence 
of words, by means of an algorithm implemented 
as a computer program. http://en.wikipedia.org/ 
wiki/Speech_recognition. 


Comprehensibility: A subjective assessment 
of ease or difficulty of comprehension as opposed 
to a measure of actual intelligibility. 


Dyspraxia: Developmental dyspraxia is an 
impairment or immaturity of the organization 
of movement. It is an immaturity in the way that 
the brain processes information, which results in 
messages not being properly or fully transmit- 
ted. The term dyspraxia comes from the word 
praxis, which means “doing, acting.” Dyspraxia 
affects the planning of what to do and how to do 
it. It is associated with problems of perception, 
language and thought. Retrieved on July 17, 
2005, from http://www.dyspraxiafoundation.org. 
uk/dyspraxia-information/whatis.html 


Fluency: The features which give speech the 
qualities of being natural and normal, including 
native-like use of pausing, rhythm, intonation, 
stress, rate of speaking, and use of interjections 
and interruptions. 


Kinesia or Kinesics: Refers to the study or 
use of non-vocal phenomena such as facial ex- 
pressions, head or eye movements, and gestures, 
which may add support, emphasis, or particular 
shades of meaning to what people are saying. 
These phenomena are known as paralinguistic 
features. The use of paralinguistic features in 
this sense is also called kinesics. 


Segmental: Segmental phonemes refer to 
the vowels and consonants of a particular lan- 


guage. 


Suprasegmental: Refers to units whichextend 
over more than one sound in an utterance, for ex- 
ample, stress and tone. Tones in tonal languages 
suchas Thai and Mandarin Chinese are one of the 
suprasegmental features of the languages. 
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APPENDIX 1: SPEAKING ITEMS 


Talk to your pair about these 5 issues. The con- 
versation will take around 12-15 minutes. 


1. Greeting and introducing yourself 
Giving and asking personal information: 
Where are you from? 

Age 

Nationality 
Occupation 
Address 
Telephone number 
Language speak 
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Talking about your family: 

How many people in your family? 

Who are they? 

How old are they? 

What is their marital status? 

What is their occupation? 

Buying things and bargaining: 

Asking about price of things 

Bargaining 

Asking and answering about directions, for 
example: 

Explain how to go from the guest house 
to the University of Social Sciences and 
Humanities 

Explain how to go from the guest house to 
Diamond plaza 
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Chapter XV 
Training for Learning 
Mandarin Tones 


Xinchun Wang 
California State University, USA 


ABSTRACT 


This study explores the effect of two training paradigms for learning Mandarin tones in pedagogical 
contexts. Eighteen beginning learners of Chinese with different first language background received three 
weeks of training as extra curriculum CALL activities. Based on learners’ choices, one group (the A 
Group, n=10) received perceptual training only with auditory input involving four-way forced choice 
identification tasks with immediate feedback. A second group (the AV Group, n=8) received perceptual 
and production training with auditory and visual input. At post test, both groups improved significantly 
in perceptual accuracy of Mandarin tones as compared with a control group (the C Group, n=10) and 
perceptual learning also generalized to new stimuli by a new speaker. Both training groups’ produc- 
tion accuracy of Mandarin tones also improved significantly at post test. The findings show that both 
training paradigms are effective and laboratory based training techniques can be implemented in CALL 
contexts. 


INTRODUCTION contours (pitch movement). For native Mandarin 
speakers, the primary cue for tone contrasts is 
pitch contours (Liu & Samuel, 2004; Xu, 1997). 


Therefore, native Mandarin listeners attach more 


Mandarin Chinese contrasts four lexical tones, 
with Tone 1 having high-level pitch, Tone 2 high- 


rising pitch, Tone 3 low-dipping pitch, and Tone 4 
high-falling pitch. The phonetic features of tones 
are acoustically manifested by the fundamental 
frequency (FO) values (pitch height) and FO 


importance to “contour” than the absolute “height” 
dimensions of tones (Wang, Spence, Jongman, & 
Sereno, 1999, 2003). Learners of Mandarin with 
no lexical tonal experience often demonstrate 
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difficulties in the perception and production 
of Mandarin tone contrasts (Wang et al., 1999, 
2003). There is also evidence that native speak- 
ers of tone languages have difficulties perceiving 
and producing non-native tones accurately. For 
example, native Cantonese and Hmong (both are 
tone languages) speakers demonstrated greater 
difficulties in identification of Mandarin tones 
than native English speakers (So, 2005; Wang, 
2006). It is speculated that tone language speak- 
ers’ difficulties with non-native tonal contrasts is 
not due to the lack of experience with tones but 
rather to the lack of one-to-one mapping between 
the L1 and L2 tones. Such mismatches between 
the two tonal systems may cause confusion to 
the learners when the similar but not identical L1 
tones interfere with the perceptual contrasts of L2 
tones, especially at beginning stage of learning 
(Wang, 2006). 

Computer-based training using speech tech- 
nology has proved to be effective for learning L2 
speech contrasts at both segmental and supraseg- 
mental levels (see more detailed discussions in 
the next section). However, there is a significant 
gap between some of the key research findings of 
laboratory studies and techniques that have actu- 
ally been put into pedagogical practice (Wang & 
Munro, 2004). This is because most laboratory 
based studies on L2 speech learning are theo- 
retically rather than pedagogically motivated and 
most training experiments have aimed at testing 
some specific theoretical hypotheses regarding 
learning rather than exploring different training 
methods for ultimate improvement through such 
training (see more discussions in the next section). 
This study attempts to address this disparity by 
applying some of the techniques used in previ- 
ous laboratory-style training studies in CALL 
environment. In particular, two computer-based 
training paradigms: perceptual only (auditory 
input using a custom designed software) and 
perceptual with production training (auditory and 
visual input using Kay Elemetrics’ Sona Speech 
II software) were implemented and compared for 
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their effectiveness in the acquisition of Mandarin 
lexical tones. The participants, 18 beginning level 
Mandarin learners (enrolled in a an introductory 
Chinese as a foreign language course in a U.S. 
university) with different L1 background received 
six hours of training within three weeks as extra 
curriculum activities. They chose one of the two 
training paradigms based on their preferences. 
The research questions to be addressed are: 


1. Will trainees improve their perception and 
production accuracy of Mandarin lexical 
tones after taking either perceptual train- 
ing (auditory input only) or perceptual with 
production training (auditory and visual 
input)? 

2. Will the perception with production train- 
ing result in better learning outcomes in 
production accuracy than the perception 
training only? 

3. If both training paradigms are effective, 
what are the advantages of each? 


BACKGROUND 


Computer-based perceptual training has proved 
to be effective in modifying adult speakers’ L2 
speech perception and production in both seg- 
mental and suprasegmental aspects of spoken 
language. In the past two decades, research has 
focused on L2 segmental contrasts (Jamieson & 
Morosan, 1986, 1989; Kinston, 2003; Rochet, 
1995; Wang & Munro, 1999, 2004), with a large 
number of studies dealing with the acquisition of 
the English /r/ and /1/ contrast by native Japanese 
speakers (Bradlow, Pisoni, Akahana-Yamada, & 
Tohkura, 1997; Hardison, 2003; Lively, Logan, & 
Pisoni, 1993; Lively, Pisoni, Yamada, Tohkura, 
& Yamada, 1994; Logan, Lively, & Pisoni, 1991, 
1993; Strange & Dittmann, 1984). Results have 
shown that after weeks of perceptual training, 
trainees improved significantly in identification 
accuracy of target L2 consonant contrasts (Jamie- 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Training for Learning Mandarin Tones 


son & Morosan, 1986, 1989; Lively et al., 1993) 
and L2 vowel contrasts (Wang & Munro, 1999, 
2004). Perceptual learning was also transferred 
to production (better production of the target 
contrast) without undergoing any training in 
production (Bradlow et al., 1997). Though stud- 
ies on L2 suprasegmentals are still very limited, 
one study reported that native English learners 
of French improved significantly in their pro- 
duction of French stress and intonation patterns 
after taking three weeks of training focused on 
prosody using computerized pitch display on 
French prosody (Hardison, 2004). 

Several training studies on Mandarin tones 
have been reported in the past two decades. In 
tworelated studies, Wang et al. (1999, 2003) found 
that beginning level native English learners of 
Mandarin improved significantly in perceptual 
identification of Mandarin tones after two weeks 
of perceptual training and perceptual learning 
also generalized to production of Mandarin lexi- 
cal tones. In another series of studies, Leather 
(1990, 1997) found that native Dutch speakers 
with no prior experience with Mandarin tones 
also benefited from a brief period of training. 
These studies tested the effect of training with a 
single L1 group (English or Dutch) with or with- 
out L2 learning experience, as well as the effect 
of perception vs. production training (Leather, 
1990, 1997). The results of the training were not 
discussed in pedagogical contexts. 

Previous studies have also developed and 
advanced different training methodologies. 
Concerning the use of training stimuli, some 
studies evaluated the impact of training using 
synthesized stimuli (Strange & Dittmann, 1984; 
Wang & Munro, 1999), and tested whether 
learning with synthesized tokens transferred to 
natural speech (Jamieson & Morosan’s, 1986, 
1989; Rochet, 1995). Other studies used natu- 
rally produced stimuli by multiple speakers, the 
High Variability Paradigm (Logan et al., 1991, 
1993), and a combination of synthesized and 
natural stimuli (Wang, 2002; Wang & Munro, 


2004). With regard to training procedures, some 
studies tested the use of discrimination training 
tasks (e.g., listeners distinguish two stimuli such 
as “right” and “light” and tell whether the first 
sounds are the same or different). Other studies 
used forced choice identification tasks such as 
requiring listeners to choose between /I/ and /r/ 
when hearing a single stimulus such as “right.” 
Still other studies evaluated a “fading technique” 
in which the key phonetic/acoustic features that 
distinguish the target contrasts suchas the English 
/e/-/6/ contrast (Jamieson & Morosan, 1986, 1989) 
and English tense and lax vowel pairs /i/-/I /, /u/- 
/O/, and /e/-/ee/ (Wang, 2002) were expanded and 
contracted along a synthetic continuum to direct 
learners’ attention to the most relevant acoustic 
cues of the target phonetic contrasts for category 
formation. 

Regarding types of input, while most training 
studies involved auditory input only, some have 
used visual input (Leather, 1990, 1997) or acom- 
bination of auditory and visual input (Hardison, 
2003, 2004) to illustrate linguistic phenomena 
such as tone and pitch. In general, such studies fol- 
low well-developed procedures that have yielded 
important insights into L2 speech phenomena 
(Logan & Pruitt, 1995). However, most of this 
work has yet to be implemented by teachers and 
learners in CALL settings. There is a significant 
gap between some of the key research findings 
of laboratory studies and techniques that have 
actually been put into pedagogical practice. 

Tworeasons for the disparity between research 
and practice can be identified. First, sophisticated 
software (e.g., speech synthesizers, such as Klatt 
[1980] and speech software, such as Kay Elemet- 
rics Sona Speech I) and digitally-manipulated 
stimuli used in laboratory studies create the 
impression that the development and use of peda- 
gogical tools are beyond the capabilities of those 
without expertise in software design and digital 
signal processing. In fact, such studies are usu- 
ally published in journals that are not commonly 
accessed by applied linguists and almost never 
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by L2 teachers (e.g., Journal of the Acoustical 
Society of America, Speech Communication). This 
is problematic, because the results of research 
may not actually reach an important audience, 
namely those who create and use pronunciation 
software. 

Second, most laboratory based studies on 
L2 speech learning are theoretically rather than 
pedagogically motivated and most training ex- 
periments have aimed at testing some specific 
theoretical hypotheses regarding learning rather 
than exploring different training methods for 
ultimate improvement through such training. 
For instance, previous training studies have in- 
vestigated the relationship between perception 
and production (Rochet 1995, Wang et al., 2003), 
and the benefits of different types of tasks and 
feedback (Jamieson & Morosan 1986, 1989; Logan 
& Pruitt, 1995), as well as the effect of auditory 
vs. visual input (Hardison, 2003; Leather, 1990, 
1997). For example, in orderto assess the effect of 
auditory vs. visual input only inlearning Mandarin 
tones, speech sound was removed for those who 
took the production training only. Therefore, the 
trainees had only visual input of pitch contours 
on a computer screen without hearing the actual 
speech (Leather, 1990, 1997). Though both train- 
ing procedures resulted in improvement in perfor- 
mance in perception and production of Mandarin 
tones by native Dutch speakers, the removal of the 
actual sound input for learning Mandarin tones 
may not be practical for L2 teaching involving 
normal hearing learners. 

Furthermore, the strict laboratory procedures 
used, as well as the theoretical constructs tested, 
makes such studies appear irrelevant to peda- 
gogy. For instance, training in the studies cited 
above has been carried out according to fixed 
schedules, with all trainees receiving the same 
training procedures, irrespective of individual 
differences and learning styles. In addition, most 
training studies also restricted the trainees to a 
particular first language to test the effect of L1 
on the acquisition of L2. Because of these con- 
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straints, such studies are almost never part of a 
language course or extra curriculum tasks that are 
relevant to pronunciation instruction. While these 
constraints are appropriate for laboratory research, 
in actual teaching settings, of course, individual 
differences must be accommodated and learners 
with different L1 background must all be allowed 
to take advantage of CALL activities. 


MAIN FOCUS OF THE CHAPTER 


With an attempt to address the disparity between 
research and practice on L2 speech learning dis- 
cussed in the above section, this study explores 
the effect of two training paradigms for learning 
Mandarin lexical tones implemented as extra cur- 
riculum CALL activities for students taking an 
introductory Chinese course. Therefore, instead 
of removing the auditory input to test the effect 
of visual input that was adopted in the Leather 
studies (1991, 1997), the perceptual with produc- 
tion training paradigm adopted in the current 
study uses the visual input to enhance auditory 
input for learning Mandarin tones. The aim is to 
provide the students with two different learning 
tools to learn Mandarin tones, if both are effec- 
tive. The study consisted of pretest, training, and 
post test phases in perception and production 
modes. The participants and tasks at each phase 
are summarized in Table 1. The procedures and 
results of training are presented in the following 
two subsections—the perception study and the 
production study. 


The Perception Study 
Participants 


The 18 trainees were undergraduate students tak- 
ing an introductory Chinese language course ina 
U.S. university at the time of the study. After the 
initial three to four weeks of concentrated instruc- 
tion on vowels and consonants as well as tones of 
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Table 1. Design of the perception and production study 


(6 hours in 3 weeks) 


speakers) 


Phase of Study Mode Tasks Participants 
Perception Identification tasks (no feedback) Trainees (18) 
Pretest Stimuli: 40 real words in Pinyin Controls (10) 
Production Read a list of 40 words in Pinyin Trainees (18) 
Perception 4 way forced-choice tasks (with immediate 
Only feedback) Trainees (10) 
Training Stimuli: 640 words (160 words x 4 


Perception & 


Auditory and visual input with real time 


(at post test phase) 


40 different words by a new speaker 


Production display of pitch contours Trainees (8) 
Stimuli: the same used in perception 
training 
Perception Same as pretest Trainees (18) 
Post test Controls (10) 
Production Same as pretest Trainees (18) 
Generalization Test | Perception Identification tasks (no feedback) Trainees (18) 


Controls (10) 


Mandarin, the weekly three-hour classroom teach- 
ing for this non-major Chinese course focused on 
the development of four skills with very limited 
time to deal with pronunciation and tones. The 
two training paradigms were thus developed by 
the instructor to provide more practice on tones 
as extra curriculum CALL activities. 

Students who volunteered to participate re- 
ceived extra points for completing six hours of 
training during a three-week period. Both training 
procedures were introduced to the students with 
live demonstration in class before the training 
began. Out of their own choices, 10 students (the 
A Group) received perceptual training with audi- 
tory input only. Eight students (the AV Group) 
received production and perceptual training with 
auditory and visual input. Another 10 students 
who did not take the training but were taking the 
same Chinese language course during the time 
of the study served as the control group (the C 
Group) for perceptual tests only. The C Group 
did not take the production tests due to schedule 


conflicts and lack of resources during the three 
week period. All participants were familiar with 
Mandarin Pinyin (Romanized sound system used 
in Mainland China) system and tonal diacritics 
used in this study because the course had already 
covered tones by the time the students took the 
training. The participants, all highly proficient 
in English, varied in their L1 background, which 
included English (6), Spanish (1), Japanese (6), 
Togalog (1), Khmer (3) (the non-tone languages) 
and Hmong (11) (a tone language). The Hmong, 
Togalog, and Kehmer speakers were born and 
raised in the United States or immigrated to the 
U.S. at very young age. All reported speaking 
their native language as first language at home 
and began to learn English since Kindergarten in 
the U.S. The native Japanese and Spanish speakers 
born andraised in their home countries (Japan and 
Columbia) were international students studying 
for an undergraduate degree in the U.S. during 
the time of this study. None of the participants 
had lived in a Mandarin-speaking environment. 
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Table 2. Participants’ age and first language in each group 


A Group Li Age AV Group Li Age C Group Ll Age 
AO1 English 18 vol Hmong 19 C01 Khmer 24 
A02 Spanish 24 V02 Hmong 18 C02 Khmer 19 
A03 Japanese 21 V03 English 18 C03 English 27 
A04 English 35 V04 Hmong 19 C04 English 44 
AOS Hmong 18 V05 Hmong 19 C05 Japanese 21 
A06 Hmong 20 V06 Japanese 22 C06 Japanese 21 
A07 Japanese 20 V07 Hmong 21 C07 Japanese 21 
A08 Togalog 20 V08 Hmong 18 C08 Hmong 19 
A09 Khmer 20 C09 Hmong 19 
A10 English 20 C10 Hmong 17 

Mean 21.6 19.3 23.2 


All had normal hearing according to self-report. 
The participants’ age and first language are pre- 
sented in Table 2. 


Materials 


The stimuli used in all perceptual tests (pre, post, 
and generalization) and both training procedures 
were produced by five native Mandarin speakers 
(two male and three female) who read a list of 
real monosyllabic Mandarin words in Chinese 
characters presented with Pinyin. In order to 
ensure phonetic contextual variability, the words 
chosen for the test and the training combine vari- 
ous initial consonants and finals with different 
syllabic structures. For the pre and post test, 40 
syllables (10 minimal quadruplets) produced by 
one of the male speakers were used. A total of 
160 syllables (40 minimal quadruplets) by each 
of the four speakers (two male and two female) 
were used for training. The fifth speaker, a female 
whose voice was not heard in the training provided 
the stimuli for the generalization test, which con- 
sisted of 40 syllables (10 minimal quadruplets). 
The purpose of the generalization test was to 
investigate whether learning was generalized to 
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new words produced by a new speaker, thus, the 
indication of improvement on tones in general, 
not as a result of being familiar with the voices 
of those heard in the training. 

The stimuli were recorded in a quiet room on 
a PC computer using GoldWave software. The 
speakers read the list of words on a Shure SM 48 
microphone connected to an M-Audio MobilePre 
USB preamplifier. The readings were recorded 
and saved at a sampling rate of 22050 Hz with 
16-bit resolution. Each stimulus was normalized 
for peak amplitude for presentation. Before the 
pretest and training, the stimuli were screened for 
intelligibility by two native Mandarin speakers 
through four-way forced choice tasks. All the 
stimuli used in the study were 100 percent ac- 
curately identified by these two native Mandarin 
listeners. 


Pretest 


The perceptual test was presented as a four-way 
forced choice identification task. The 40 test stim- 
uli produced by a male speaker were randomized 
and presented on a Macintosh computer througha 
built-in speaker system in a classroom. A printed 
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out answer sheet in Pinyin marked with tonal dia- 
critics was presented to the listeners before the test. 
The experimenter then explained the identification 
task with examples and familiarized the listen- 
ers with the test procedure through a short trial 
session. During the test, the listeners heard each 
stimulus only once at an inter stimulus interval 
(ISI) of six seconds. Every time a stimulus was 
played back, the listeners identified the tone of the 
test stimulus by circling the corresponding tone 
on the answer sheet. The results were analyzed by 
calculating the percentage correct identification 
of the 40 test stimuli by each listener. 


Perceptual Training (Auditory Input) 


Perceptual training was carried out individually 
in a language lab on Macintosh computers using 
custom-designed software. The training stimuli, 
640 real words (160 from each of the four speakers), 
were blocked by speakers. Each speaker’s words 


were subdivided into four blocks of 40 stimuli 
each for presentation. The trainees heard the 
stimuli through a pair of headphones and identi- 
fied the stimuli as a four-way forced choice task 
with immediate feedback. The labels used were 
“1”, “2”, “3” and “4” for the four corresponding 
Mandarin tones and appeared as four buttons 
on the computer screen during the training. The 
trainees were told to pay attention to the tones only 
for each stimulus presented. Every time a trainee 
identified a stimulus that matched one of the four 
tones by clicking the corresponding button, im- 
mediate feedback in the form of words “Correct” 
or “Sorry, that should be Tone X” flashed on the 
screen. As soon as the trainee made a choice by 
clicking one of the four buttons, the next token was 
then automatically played for identification. Each 
stimulus was played only once but the trainee had 
the control over the pace of the stimulus presenta- 
tion by either immediately or delaying clicking 
the button each time after hearing a stimulus. By 


Figure 1. A native speaker’s pitch contour (top screen) of the syllable “can” in Tone 3 overlaid on a 
trainee’s pitch contour of the same syllable and tone (bottom screen) (Copyright 2007, Kay PENTAX. 


Used with permission.) 


PDF created with pdfFactory trial version www pdffactory com 
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the end of the session, the program automatically 
calculated the percentage of correct identifications 
and provided the score on the screen. The trainee 
could then choose to replay the block or move on 
to the next block. 


Perception and Production Training 
(Auditory and Visual Input) 


The same stimuli used in the perceptual training 
were also blocked by speakers for presentation 
in perception with production training. Indi- 
vidual training sessions were conducted on a PC 
computer using Kay Elemetrics Sona Speech II 
Software with a Shure SM 48 microphone con- 
nected to an M-Audio MobilePre USB preampli- 
fier. During the training, the trainee opened and 
played back (through a pair of headphones) each 
training stimulus with real time display of the 
pitch contour in the top window of Screen A on 
the computer screen. The trainee then repeated 
the target tonal syllable and recorded his/her own 
production of the target tone by speaking into the 
microphone. The pitch contour of the trainee’s 
production was instantly displayed in the bottom 
window of Screen B. 

The trainee could then compare his/her own 
sound with the target sound by playing them 
back repeatedly (auditory input). The trainee 
could also visually compare the two tones by 
overlaying the pitch contour of the target tone on 
that of his/her own production in different colors 
while alternately playing them back for auditory 
comparisons. An example of the training inter- 
face is given in Figure 1. The trainee could also 
clear his/her own production to record again and 
practice each target tone repeatedly or choose to 
move onto the next target sound. 


Training Logs 


Thetrainees from both groups practiced the train- 
ing stimuli at a comfortable pace and recycled 
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the four speakers’ training stimuli during the 
six hours of training spread across three weeks 
according to their own schedules. To keep track 
of progress, each trainee kept a training log that 
recorded the date, the time, the number of train- 
ing blocks, and the speaker(s) they practiced on 
during each one hour training session. 

The analysis of the training logs showed 
that trainees in A Group recycled more training 
stimuli than the AV group. For example, the A 
Group trainees completed all the 160 stimuli by 
one speaker (and sometimes more) in each one 
hour training block while the AV Group trainees 
normally completed a portion of the 160 stimuli by 
one speaker during the same time frame in each 
training block. This was because the AV group that 
received perception and production training with 
both auditory and visual input spent more time on 
each single stimulus by recording and comparing 
their own productions with the target tones one by 
one. They also had to open each training stimulus 
one by one for such comparisons. In contrast, 
the A group that received perceptual training 
only did not record their own productions and 
did not need to open teach stimulus one by one. 
Therefore, while the perception with production 
training had the advantage of auditory and visual 
input simultaneously and allowed for practice on 
production, the perceptual training only paradigm 
appeared to have the advantage of shorter inter 
stimuli intervals (ISD) which allowed for playing 
back much more training stimuli within the same 
time frame. 

The exact number of stimuli each AV Group 
trainees completed during each one hour training 
session was not recorded on the log as the program 
did not automatically provide such information. 
The A Group trainees also varied slightly on the 
exact number of stimuli they completed during 
each one hour training session. However, all 
trainees in both A and AV groups completed the 
training on each one of the four speakers by the 
end of the six hour training. 
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Posttest and Generalization Test 


Within the same week training was completed, the 
trainees took the post test in which they repeated 
all the tasks of the pretest. The control group 
also took the same post test at approximately the 
same time interval between the pretest and post 
test as the trained group. In addition to the post 
test, all groups took the generalization test which 
consisted of 40 new stimuli by a female speaker 
whose voice was not heard during the pretest and 
training phrases. The generalization test was pre- 
sented to the listeners in the same test procedure 
as the pre and post test and was administered 
immediately after the post test. 


Results 


The mean percentage correct identification (“% 
ID) scores of the Mandarin tones by all three 
groups at pretest, post test, and generalization 
test are presented in Figure 2. Overall, the mean 
percentage increase from the pretest to post was 
21 percent, 11 percent and 3 percent for the A 


group, the AV group and C group respectively. 
For the generalization test, the percent ID was 
89 percent, 92 percent and 62 percent for the A 
group, the AV group and C group respectively. 
A two-way repeated measures ANOVA with 
Group (A, AV, C) as between subject factor and 
Test (pre, post, generalization) as within subject 
factor showed an effect of Test [F(2, 50) = 19.039, 
p= .000] and an effect of Group [F(2,25) = 6.258, 
p = .006]. The Group x Test interaction was also 
significant [F(4, 50) = 5.736, p = .001]. To further 
explore the differences between groups and tests, 
a series of one-way ANOVAs were carried out. 
These tests established significant differences 
between the groups on post test [F(2,27) = 7.656, 
p=.003] and generalization test [F(2,27) = 7.750, 
p = .002] but not on pretest [F(2,27) = 2.732, p = 
.085].Post hoc (Tukey HSD) multiple compari- 
sons (ax< .05) revealed significant differences on 
post test and generalization test between the AV 
and C groups, and between A and C groups, but 
not between the A and AV groups. These results 
showed that both A Group and AV Groups were 
comparable to the C Group at the pretest phase 


Figure 2. Mean percent correct identification of the four Mandarin tones and standard errors for A 
group, AV group, and C Group at pretest, post test, and generalization test 


@ Pretest 
OPost test 
m Gen. test 
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but both training groups outperformed the C 
Group at post test and generalization test in their 
perceptual accuracy of the four Mandarin tones 
significantly. Therefore, both training paradigms 
were effective in perceptual learning of Mandarin 
tones. The perceptual learning was also general- 
ized to new stimuli and a new speaker not heard 
during training. The differences between the A 
Group and AV Group were not significant. 


The Production Study 
Participants 


Both A group (10) and AV group (8) took the pro- 
duction tests. The control group did not take the 
production tests due to the lack of resources and 
conflict of schedules during the three week time 
frame. Two native Mandarin speakers (one male 
and one female) residing in the U.S. identified the 
trainees’ productions ina forced choice task. Both 
listeners had normal hearing according to self- 
report. One of the listeners, the instructor, knew 
the trainees through classroom contact. The other 
listener did not know the speakers. The impact 
of being familiar with the speakers is believed to 
be slight, if any, for a forced choice task like this 
because the listeners had to identify the tone of 
each isolated word randomly presented one by one 
by matching it with one of the four tones. 


Materials 


At perceptual pretest and post test phases, each 
trainee also provided production data by reading 
a list of 40 mono-syllabic real Mandarin words 
(10 minimal quadruplets) presented in Pinyin with 
tonal diacritics (See Appendix). Like the syllables 
used in the perceptual test, these words resemble 
a variety of syllable structures of Mandarin. The 
speakers had already learned all Mandarin vowels 
and consonants as well as the Pinyin system by 
the time of the study. Still, before recording, the 
experimenter went through the reading list with 
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the trainees and clarified any questions they had 
to ensure that the participants knew the correct 
pronunciation of each tonal syllable on the list. 

The recordings were made immediately before 
the perceptual test at pretest phase and immedi- 
ately after the perceptual test at post test phase. 
The participants were instructed to read at normal 
speed and to correct any errors by repeating the 
same syllables at any time during the recording. 
The trainees read the list onto a Sanyo Talk-Book 
VAS mini cassette recorder through an external 
microphone in a quite classroom. The recordings 
were digitized using Goldwave software at a 
sampling rate of 22050 Hz with 16-bit resolution, 
normalized for peak amplitude and saved as sound 
files for presentation. Each trainee produced 80 
tonal syllables (40 at pretest and 40 at post test), 
yielding a total of 1440 testing tokens (18 speak- 
ers x 80 stimuli). 


Mandarin Listeners’ Perceptual 
Judgments 


Twonative Mandarin speakers judged the trainees’ 
productions in forced choice identification tasks. 
The 1440 stimuli were blocked by the speakers 
producing 18 testing blocks of 80 stimuli each. 
In each test block, one speaker’s pretest and 
post test stimuli were mixed and randomized 
for presentation. Individual identification tasks 
were performed in a quiet room on a Macintosh 
computer using customer-designed software. 
The stimuli were presented through a pair of 
headphones at comfortable volume. In addition 
to the four labeled buttons “1”, “2”, “3”, and “4” 
that correspond with the four Mandarin tones, a 
fifth button, “None,” was also presented on the 
screen to provide an option for the judges in cases 
the speakers’ productions were judged as none 
of the four tones. During the test, each stimulus 
was played only once and the listener identified 
the word by clicking one of the labeled buttons 
corresponding to the tone he/she heard. The lis- 
tener had the control over the pace of the test by 
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either immediately or delaying as much as he/she 
wanted in clicking the button each time after a 
stimulus was presented. As soon as the listener 
clicked the button, the next trial was played back. 
For each listening block, the test data were col- 
lected automatically by the computer and saved 
for subsequent analysis. The identification tasks 
took about three hours to complete with manda- 
tory breaks in between blocks. 


Results 


To access inter-listener variability, Pearson cor- 
relation tests were performed on the two listeners’ 
percentage correct identification scores of the 
18 speakers’ productions. These tests revealed 
acceptable level of correlation between the two 
Mandarin judges’ identification scores for the 
pretest (r = .840) and for the post test (r = .778). 
Therefore, the two listeners’ identification scores 
were averaged for analysis. Figure 3 presents the 
mean percentage correct production scores of 
the A group and AV group at pre and post test as 
judged by the two native Mandarin listeners. 


Overall, the A group showed an improvement 
of 17 percent points, from 68 percent at pretest 
to 85 percent at post test. For the AV group, the 
increase was 13 percent points, from 76 percent 
at pretest to 89 percent at post test. A two-way re- 
peated measures ANOVA with Test (pre and post) 
as within subject factor and Group (A and AV) 
as between subject factor revealed a significant 
effect of Test [F(1,16) = 25.486, p = .000] but no 
effect of Group [F(1,16) = 2.204, p = .157]. There 
was no Test x Group interaction [F(1,16) = .470, 
p =.503] either. These results show that although 
the AV group had higher mean production scores 
than the A group at both pretest and posttest, these 
differences were not statistically significant. Both 
training groups’ production accuracy of Mandarin 
tones improved significantly at post test. 


CONCLUSIONS 


Revisiting the three research questions raised 
earlier, the data provide positive answer to ques- 
tion 1 which asked whether the trainees would 


Figure 3. Mean percent correct production scores of the four Mandarin tones and standard errors for 
A group and AV group as judged by native Mandarin listeners 


@ Pretest 
OPost test 
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improve their perceptual and production accuracy 
of Mandarin tones after taking either perceptual 
training only or perceptual with production train- 
ing. Both training groups improved significantly 
from pretest to post test in perception accuracy 
of Mandarin tones as compared with a control 
group taking the same course but not receiving 
the training. In addition, perceptual learning was 
generalized to new stimuli and a new speaker not 
heard in the training. 

In production, both A and AV groups improved 
their production accuracy of the Mandarin tones at 
posttest. The improvementin production accuracy 
was comparable for both training groups even 
though the A Group received perceptual training 
only. For the A Group, this means that learning 
in perception was generalized to production as 
they improved significantly in production accu- 
racy of Mandarin tones without undergoing any 
production training. For the AV Group, although 
their production accuracy improved significantly 
from pretest to post test, they did not significantly 
outperform the A Group in production accuracy. 
Therefore, the results did not support research 
question 2 which asked whether the perceptual 
with production training would result in better 
learning outcomes in production accuracy than 
the perception training only paradigm. Both 
training paradigms proved to be effective for 
learning Mandarin tones when implemented as 
extra Class activities. 

With regard to the advantages of the two train- 
ing procedures, which answers research question 
3, the analysis of the training logs showed that 
trainees who received perceptual training com- 
pleted at least one speaker’s 160 training stimuli 
in each one hour training block while those who 
received perceptual with production training did 
not usually do so during the same time frame. 
Therefore, while the perceptual with production 
training paradigm has auditory and visual input 
and allows for production practice that may 
benefit some learners, the auditory training only 
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paradigm appears to have the advantage of shorter 
inter stimuli intervals (ISI) which allows for play- 
ing back much more training stimuli within the 
same amount of training time. The data suggest 
that perceptual training only is sufficient for 
improvement in both perception and production 
of Mandarin tones. However, as both training 
paradigms were effective, learners may chose 
either one of the two that accommodates their 
learning styles or interests. They may also take 
advantage of both training paradigms at different 
times to benefit from both procedures. 

It is important to note that, by design, the 
trainees were not controlled for their L1 back- 
ground as they volunteered to take the training 
as extra curriculum CALL activities. As aresult, 
the current data were not analyzed to assess the 
effect of L1 background on the acquisition of 
Mandarin tones. However, the overall improve- 
ment of both training groups which include both 
tone (Hmong) and non-tone language speakers 
(Japanese, English, etc.) suggests that learners 
who had difficulties with Mandarin tones can all 
benefit from both training procedures regardless 
of their L1 background. 


Limitations 


One limitation of the current study is the lack 
of a control group for the production study. Al- 
though the control group did not make significant 
improvement in perceptual accuracy of the target 
Mandarin tones, it would still be ideal to have the 
control group take the production tests ifresources 
and schedules permitted. Another limitation ofthe 
training is the focus on isolated tones only. Like 
previous training studies on the acquisition for 
learning Mandarin tones, the focus of the study 
did not go beyond tones in isolation, which is 
monosyllabic. Future training studies on learning 
L2 tones need to address the problem of percep- 
tion and production of tones in larger linguistic 
units such as phases and sentences. 
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FUTURE TRENDS 


Previous research indicates that L2 tones are dif- 
ficult to master for both tone language and non- 
tone language speakers. The findings of this study 
show that both training paradigms are effective 
for learning Mandarin tones and laboratory based 
training techniques can be implemented in CALL 
contexts. Speech technology commonly used in 
L2 speech perception and production research 
can be applied pedagogically. Computer-based 
perceptual and production training paradigms 
can be developed and effectively implemented as 
CALL activities to enhance and supplement L2 
pronunciation teaching. Learners may be more 
willing to participate such activities when they 
are directly related to their classroom learning 
and when they have some control over the choice 
of the tasks based on their needs and preferences. 
This brings up the purpose of designing and 
implementing computer-based training tasks for 
learning L2 pronunciation. With ever-increasing 
student access to computertechnology and CALL 
software, the current trend in CALL emphasizes 
the use of technology to facilitate and enhance 
language learning. Therefore, “rather than com- 
paring the classroom with CALL, it seems that 
the challenge is to provide evidence for the most 
effective way to design software for CALL, to use 
the software effectively in tasks, and to help learn- 
ers to take advantage of the electronic resources 
available to them” (Chapelle, 2003, p. xiii). The 
development and implementation of future CALL 
software for L2 pronunciation training should 
move away from comparing the conventional 
classroom based instruction with a particular 
CALL software to focus on designing alterna- 
tive CALL activities to enhance but not replace 
classroom teaching. Furthermore, effective CALL 
activities implemented outside class to improve L2 
pronunciation will help the instructors to preserve 
precious instruction time for other tasks in the 
mostly communicative learning environment in 


current L2 classrooms where the ultimate goal is 
to learn to communicate in the target language. 
Much work needs to be done in this area and this 
study takes a step toward that direction. 
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KEY TERMS 


Computer-Based Perceptual Training: 
Using speech software on a computer to either 
discriminate or identify the differences between 
the target speech sounds, usually with immedi- 
ate feedback. 


Computer-Based Perceptual with Produc- 
tion Training: Using speech software such as 
Kay Elemetrics’ Sona Speech to playback (audi- 
tory input) and display the pitch contour in real 
time on a computer screen (visual input) to learn 
L2 tone or intonation. Learners can also record, 
playback, and compare the pitch contours of their 
own production with those of the target stimuli. 


Discrimination Tasks with or without 
Feedback: Listeners distinguish two stimuli 
such as “right” and “light” and tell whether 
the two sounds are the same or different. Such 
discrimination tasks can be performed without 
feedback when it is used for perceptual test. It is 
performed with immediate feedback when it is 
used for perceptual training. 


Forced Choice Identification Tasks with or 
without Feedback: When a target L2 sound such 
as /t/ is presented as a single stimulus (often in 
a syllable or word such as “right”), the learner 
is asked to choose between /I/ and /r/ and label 
the sound accordingly. Such identification tasks 
can be performed without feedback when it is 
used for perceptual test. It is performed with im- 
mediate feedback when it is used for perceptual 
training. 


Lexical Tone: The change of pitch at word level 
results in the change of the meaning of a word. 


Pitch Contour: The movement (the rising or 
falling) of pitch can be visually displayed on a 
computer screen. 


Segmental Difficulties in L2 Perception and 
Production: The difficulties L2 learners have in 
perceiving and producing the contrasts between 
individual speech sounds (vowels and consonants) 
such as the English /I/ and /r/ distinction for native 
Japanese speakers. 


Suprasegmental Difficulties in L2 Percep- 
tion and Production: The difficulties L2 learners 
have in perceiving and producing the proper pitch 
or intonation patterns, stress or rhythm patterns, 
and tempo features of the target language. 


Inter Stimulus Intervals (ISI): The time 
interval between the two stimuli played back 
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APPENDIX 
Reading List for Production Study 


Please read the following pinyin syllables with 
the marked tones: 


1 6gé ge gé ge 
2. piao piao pido piao 
3. Lid lid lit lid 
4. du du du du 
5. can can can can 
6. ai ai ai a 

7. yd yu yu yu 
8. féi féi féi féi 
9. hong héng hdng hong 
10. ba ba ba ba 
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Chapter XVI 
An Evaluation of a Listening 
Comprehension Program 


Nattaya Puakpong 
Suranaree University of Technology, Thailand 


ABSTRACT 


This chapter examines the effect of an individualized Computer-Enhanced Language Learning Listen- 
ing Comprehension Program (MMExplore) on students’ listening comprehension ability in the context 
of learning English as a Foreign Language in the Thai University system. MMExplore is an audio-vi- 
sual media browser which is designed to provide learners with a wide variety of ways to interact with 
authentic listening texts. In 2003, MMExplore was used by twenty first year students of the Suranaree 
University of Technology (SUT), Thailand for a period of fifteen weeks with a minimum of four hours 
of training per week to evaluate the effect of this program on student performance. Various forms of 
evaluation, both qualitative and quantitative, were used. The findings of this research suggest that (a) 
there is an observable gain in students listening comprehension ability in English after training; and 
(b) the majority of the students were favourably towards this program. 


INTRODUCTION 


As second language (L2) language researchers/ 
teachers, we are charged with the task of preparing 
students of L2 to be proficiency users of that L2 
in real life situations. It is, therefore, necessary 
to investigate learning activities which may aid 
in this preparation. Among the four macro skills 
in language learning, listening comprehension 


is one of the hardest skills to acquire. One of the 
reasons is that what listening entails is still not 
well understood. For instance, the traditional 
model of listening comprehension assumes that 
listening is a receptive and passive skill where the 
listeners “catch” the ideas delivered to them by the 
speakers through sense of hearing and then under- 
stand the message (Brown, 1990). However, more 
recent studies suggest that listening is a complex 
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cognitive process rather than a passive process by Mayer, 1992; Pusack & Otto, 1997; Rost, 1990). 
which listeners simply receive a spoken message In fact, Sakuma (2004) argues that listening is a 
(Fischer & Farris, 1995; Joiner, 1997; Lynch, 1995; very active skill which requires listeners to ap- 


Table 1. Types of practice for improving listening comprehension (Taken from Goh, 2000, p.72) 


I. Perception practice 

a. Listen to how new vocabulary items are pronounced 

b. Follow along with transcript of recording 

c. Write down content words from short passages 

d. Identify the most prominent word in short utterances 

e. Identify meaning groups in sentences of varying lengths 

f. Identify tones and their communicative value 

g. Identify common discourse markers and their functions 

h. Identify common phrasal verbs and their meaning 

II, Listening strategy practice 

Cognitive tactics 

a. Infer missing or unfamiliar words using contexts, co-text and prior knowledge 
b. Predict general contents before listening using contexts and prior knowledge 
c. Predict unfinished utterances using contexts, co-text and prior knowledge 

d. Use prior knowledge to elaborate and complete interpretation 

e. Take short notes of important content words 

f. Relate limited interpretation to a wider social/linguistic context 

g. Relate one part of the text to another 

h. Visualise scenes, objects, events etc. being described 

i. Reconstruct meaning using words heard 

Meta-cognitive tactics 

a. Preview contents in different forms 

b. Rehearse the pronunciation of potential content words 

c. Establish purpose for listening 

d. Listen selectively according to purpose. 

e. Pay attention to discourse markers 

f. Pay attention to visuals and body language 

g. Pay attention to tones and pauses 

h. Monitor comprehension using contexts and prior knowledge 

i. Evaluate comprehension using contexts, prior knowledge and external resources 
j. Continue to listen for clarification in spite of difficulty 

k. Assess the importance of problematic parts and decide whether to ignore them or actively seek 
clarification 

i. determine the potential value of subsequent parts and vary intensity of attention accordingly 
Social affective tactics 

a. Ask speaker for clarification and repetition 

b. Paraphrase what speakers say to check understanding 

c. Learn to relax before and during listening 

d. Encourage oneself to continue listening 
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ply several functions simultaneously each time 
they receive the message; and that listening is 
much more than simply receiving sound waves 
through hearing. 

Hatch and Hawkins (1987) describes an in- 
teractive relationship between learners’ mental 
systems and their mental representations of 
experience in second language acquisition. This 
relationship is considered to have “developed 
through reiterative and continuous adjustment of 
learners internal representations of data based on 
their exposure to external linguistic data” (Kita- 
jima & Lyman-Hager, 1998). When listening to an 
L2, the perceived sound waves through hearing 
act as stimuli which cause the learners’ mental 
systems to interact with their mental representa- 
tions of experience in the L2. External factors 
on L2 learning such as context may also play an 
important role in second language acquisition. 
Tomlin and Villa (1994) state that language ac- 
quisition occurs when learners: 


1. catch some element of linguistic input from 
exposure; 

2. perceive a new or unusual characteristic in 
the event they witness; and 

3. establish arelationship between the linguis- 
tic input and the mental representation of 
the event. 


However, in a foreign language learning en- 
vironment, opportunities to interact with various 
target language contexts are very limited. This 
creates a number of difficulties by L2 learners 
in listening to the target language due to lack of 
practice. A recent study conducted by Goh (2000) 
on the difficulties encountered by L2 learners in 
listening suggest that students (1) Quickly forget 
what is heard; (2) Do not recognise words they 
know; (3) Understand words but not the intended 
message; (4) Neglect the next part when think- 
ing about meaning; (5) Unable to form a mental 
representation from words heard. Such problems 


made it difficult for L2 learners to even start detect 
relevant input in the process of listening. 

In short, to develop L2 learners’ listening 
comprehension skills in the target language, they 
need to be provided with varied target language 
data as well as practices in perceiving the L2 and 
develop strategies to cope with L2 data. Goh (2000) 
recommended a list of practices which might be 
used in this regard (Table 1). 


Advantages of Using Video Media in 
L2 Settings 


In the past 20 years, many comparative media 
studies have been carried out to investigate the 
use of analogue video media in second language 
settings. Many studies have been directed at the 
investigation of video-mediated listening com- 
prehension (Baltova, 1994; Berry, 1995; Chung, 
1994; Gruba, 1993; Kasten, 1995; Progosh, 1996; 
Secules, Herron, & Tomasello, 1992; Tudor & 
Tuffs, 1991). The results of these studies found that 
in general, video instructed group performed bet- 
terin listening comprehension than the non-video 
instructed group. This trend led Ryberg (1995) to 
conclude that a rise in listening comprehension 
scores when video was used was due to the provi- 
sion of both contextual clues and paralinguistic 
information. However, findings in listening 
comprehension research using video are by no 
means consistent due to a wide variety of settings, 
candidate profiles and choice of videotexts. For 
instance, one of the key variables in such research 
is the length of video the students are exposed to. 
Rubin (1995) recommends that video samples be 
limited to no more than two minutes as exposure 
to long and complex media may strain cognitive 
resources of listeners, particularly in relation to 
the capacities of working memory. 

Advantages of using video mediainL2 settings 
also extend to the use of digital video media. One 
of the biggest advantages of digital video media 
is the ease of operating digital video allowing L2 
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students to be much more autonomous. Apart from 
the provision of contextual clues and paralinguistic 
information, digital video clips also allow students 
to rewind and catch and not forget, what is heard; 
recognise perceptually the words they know at L2 
learners’ own speed; spend time pondering over 
the intended message; experience allocating their 
attention to different parts of the message; and 
try to form a mental representation of the words 
heard. Furthermore, many of the activities listed 
in Table 1 can be incorporated into tasks using 
digital video. 

This chapterreports on an investigation carried 
out ina Thai University for a group of 20 L2 stu- 
dents of English who used a multimedia browser- 
MMExplore (Lian, Lian, & Puakpong, 2003) to 
develop or improve their listening comprehension 
skills. Many tasks listed in Table 1, in the tasks 
designed for MMExplore, have been incorporated. 
These involved (1) tasks that help students focus 
on meta-cognitive strategies such as focussing on 
relevant features of discourse, body language and 
other aspect of cultures as they are being heard; 
(2) feedback facilities which are designed to aid 
students; (3) tasks that require students to engage 
in perception practices as well as cognitive and 
meta-cognitive strategies practices. 

Specifically, the research addresses the fol- 
lowing questions: 


1. Using the non-participating students as the 
control group (CG), do participating stu- 
dents (the MMExplore group(EG)) appear 
to have achieved a greater comprehension of 
the video and audio as measured by marks 
gained in the “Listening” part of the final 
examination in 2003? 

2. Using the participating students’ responses 
to listening tasks as measured by the global 
ideas (GI) and specific details (SP) written 
down inthe written and multiple choice parts 
of pre-experiment listening test (pretest) 
as control, do the same students appear to 
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have achieved greater comprehension of the 
video and audio as measured by the number 
of global ideas (GI) and specific details (SP) 
written down in both the written and multiple 
choice parts of a post-experiment listening 
test (posttest)? 

3. | What patterns of use can be found in the 
students’ usage of the MMExplore when a 
systematic examination of the electronic log 
files that kept track of student behaviour is 
undertaken? 


In this study no participant has previously 
seen the video clips chosen for the study and no 
participant has serious hearing impairment or 
visual problems. In the next section, the features 
of the MMExplore are briefly described. 


FEATURES OF THE LISTENING 
COMPREHENSION PROGRAM 


MMExplore (Lian et al., 2003) is a refinement 
of its predecessor MMBrowse (Lian & Lian, 
1995; Lian & Zhang, 1997). It is a system de- 
signed to facilitate the exploration of authentic 
text in a variety of ways with special emphasis 
on the development of listening skills. It enables 
learners to discover, observe, and reflect on the 
meanings of individual texts while varying the 
processing load. 

All listening clips used in the program were 
originally in analog format on video tapes. They 
were then transformed into the digital format. 
Three main software programs were employed to 
develop the program: ToolBook (Sumtotal), Cool 
Edit (Syntrillium, 2002), and Adobe Premiere 6. 
ToolBook is an authoring program that was the 
main program used in developing the MMEx- 
plore. It contains some ready-made functions but 
they had significant limitations in terms of the 
functionality demanded of MMEXplore. Conse- 
quently, new scripts had to be written to provide 
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increased functionality within the program. Cool 
Edit 2000 (Syntrillium, 2002) and Adobe Premiere 
6 were used to manipulate all related video and 
audio files used in the program. Cool Edit 2000 
was used to slow down and speed up audio files 
and it was used to filter out words from the audio 
files (by eliminating frequencies above 300 Hz) 
so that only rhythm and intonation of the clip was 
left. Adobe Premiere 6 was employed to extract 
a sound file from a video file and to incorporate 
filtered sound files into normal video files. Extra 
noise files were also mixed into the audio-visual 
file through Adobe Premiere 6. 

Broadent (1958), Brown (1995), and Cowan 
(1995) point out that learners have limited cog- 
nitive load and memory span to use in dealing 
with listening tasks under normal circumstances. 
Listening comprehension is a task that requires 


Figure 1. The *starred version of the transcript 


- 


As 7 ie | 
Cw) wrote - | Se | 


Understand? 


heavy cognitive load from learners because they 
cannot go back to refer to the texts the way they 
can when reading difficult texts. Rather, to con- 
struct meaning, they have to hold the content and 
meaning of the previous message in their short 
term memory while continuously receiving the 
new message. The learners’ cognitive load is even 
more limited in coping with tasks in the second 
language. 

The MMExplore assists listeners in the cogni- 
tive aspect of listening by offering them various 
load reduction functions. For example, they can 
select the chunk that they would like to focus on 
at a particular time and in doing so reduce the 
load they have to process at one time. They are 
also provided with the facility to slow down the 
recording which also reduces the load they have to 
process as well as allowing them more processing 


279 


Presented by: httos://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


time. A filtered version which removes the words 
and leaves only rhythm and intonation for learners 
to focus on is also available. 


MAIN WORKING PAGE 


To facilitate the exploration of authentic text, the 
program offers learners the ability to view orlisten 
to any arbitrarily-selected portion of a text ina 
variety of modes: full audio-visual, audio only, 
video only, fast, slow or noisy versions. The version 
that encourages exploration most is the starred 
(*) transcript. By clicking on the <Display type> 
button, a *starred and normal text version of the 
transcript can be found. The starred version of 
the clip contains a transcript with all characters 
replaced with stars; spaces and punctuation marks 
are preserved. 

For example, the sentence “Xavier attended 
the International Children’s Conference” will 
appear like Example 1. 

Although students know how many words are 
in each sentence and how many characters are in 
each word, they do not know what the words are 
until they listen to the clip. The starred version of 
the clip acts as a kind of puzzle which promotes 
the act of predicting forward without having 
heard everything. For example, upon guessing 
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the first few letters of the word “International,” 
students might be able to predict the rest thus giv- 
ing them a sense of accomplishment. Secondly, 
forcing students to listen in order to get the words 
also alerts them to some often neglected areas 
of English pronunciation such as the linking of 
words. For instance, in an English sentence such 
as “Do you have childhood memories of school 
rooms full of books or rooms full of computers?” 
in running speech, many words are linked (See 
Example 2). 

If students are taught to look out for such 
phenomena in spoken English and if exercises to 
highlight such phenomena are embeddedas part of 
the program, then MMExplore will alert students 
to an important aspect of the English language 
and can bea good way to get students away from 
learning English through reading the text. 


FEEDBACK PROVISION 


In support of their “raw” viewing/listening they 
are given further assistance through the “starred” 
transcript and other inferencing and guessing 
exercises, explanations and glosses. These expla- 
nations and glosses are available automatically in 
response to learners’ interactions withthe program 
but they can be provided on demand as well. 


Example 1 
Xavier attended The International Children’s Conference 
ok 2k ok ok ok ok 2k ok 2k ok ok ok ok ok ok ok ok 2k ok ok ok 2k 2k ok ok ok ok ok ok ok 2h ok ok ok ok ok ok ok ok 2k 2 ok ok 2k ok ok ok ok ok 
Example 2 
Memories of Becomes Memoriesof 
Books of Becomes Booksof 
Full of becomes Fullof 
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Learners click on words or chunks of language 
in a variety of ways and receive different forms 
of feedback from the program. 

Further load-lightening of “raw” multimedia 
information is provided through electronic low 
pass digital filtering of speech to highlight into- 
nation patterns, as well forward and backward 
build-up of speech in order to bring out previously 
undetected features of spoken English. 

Building an awareness of the rhythms and 
intonations of English is essential for Thai learn- 
ers of English because of the tonal nature of Thai 
language. In Thai, each word is attached to one of 
the five tones: mid, low, high, rising, and falling. 
Attaching the wrong tone to a word would change 
its meaning completely. Thai is also categorized 
as a syllable-timed language. In syllable-timed 
languages the syllables are said to occur at regular 
intervals of time. Stress within Thai is expressed 
in terms of loudness and duration. 

English, on the other hand, is a stress-timed 
language. In other words, in English each syllable 
pronounced in a sentence does not receive equal 
importance. That means the speaker can stress 
certain words, whereas other words are quickly 
spoken. English speakers spend more time on 
specific stressed words while quickly gliding over 
the other, less important, words. Vowel duration 
is highly variable. Intonation is a very important 
feature because it conveys a range of meanings, 
emotions or situations beyond the actual meanings 
of words inthe sentence (Renard, 1975). However, 
theseare very difficult aspects formostnon-native 
speakers including Thai students. They usually 
employ their familiar system or native language 
system in listening in learning English. They per- 
ceive the foreign language through the system of 
their native language. Trubetzkoy (1939) explains 
the tendency to do this as follows: 


The phonological system of a language is like 
a sieve through which everything that is said 
passes ... Starting from childhood, each person 


becomes accustomed to analysing what is said 
in this fashion. This analysis is carried out quite 
automatically and unconsciously. The system of 
the “sieve,” however, which makes such analysis 
possible, is structured differently in each language. 
Each person acquires the system of his mother 
tongue. But when he hears another language 
spoken he intuitively uses the familiar language; 
numerous mistakes and misinterpretations are the 
result. (pp. 51-52) 


Therefore, it is expected that learners are 
most likely to perceive English language sounds 
through the system of their native language, in 
this case, Thai. Consequently, they may have a lot 
of difficulties in comprehending a listening clip 
in English because they are not familiar with a 
stress-timed language such as English. Although 
recognising the differences between Thai and 
English, they might totally ignore the rhythmic 
aspect of English and choose only to concentrate 
on the segmental aspect of this language when 
listening to the clips. 

Renard (1975) and Anderson-Hsieh (1994) 
point out that although rhythm and intonation 
play a very important role in communication, 
when they are listening to the spoken discourse 
in English, students often ignore the overriding 
melody and rhythm of utterances and put an 
emphasis on comprehension at the lexical level. 
It is, therefore, essential that students be given an 
opportunity to directly focus upon rhythm and 
intonation in order to build their awareness of 
the intonations and rhythms of English. Students 
then might be able to overcome the unconscious 
habit of filtering the sounds of English through 
the phonological sieve of their mother tongue. 
This awareness can be raised by activities such 
as backward and forward chaining. 

The backward build-up of a sentence is 
sometimes called back chaining. The last word 
is presented first and then the second-last word is 
added on and the chunk is played. The program 
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gradually builds up the chunk until the selected 
chunk is complete. For example, if the selected 
chunk is “Xavier attended the international 
Children’s Conference,” the program presents 
them with this: 


Conference 

Children’s Conference 

international Children’s Conference 
the international Children’s Conference 


attended the international Children’s Confer- 
ence 


Xavier attended the international Children’s 
Conference 


This provides the learners with an opportunity 
to focus on the rhythm and intonation pattern 
of the chunk. The ability to approach the chunk 
in various ways may help them in comprehend- 
ing the clip because as Larsen-Freeman (2000) 
points out, the backward build-up breaks down 
the sentence into several parts, and students can 
focus on each part at a time. This also is useful 
for developing an awareness of the intonation 
build-up. Learners are provided with a further 
opportunity to focus on intonation and rhythm 
of the chunk. The program can consistently build 
up the chunk by invariably presenting the same 
rhythm and intonation in a growth pattern. This 
build-up can help reduce the load that they have 
to process each time so they slowly process them 
and focus better. It also allows them to perceive 
the same chunk differently and build up a better 
understanding of how it is constructed and what 
it means. 

In a forward build-up or forward chaining, the 
first word is presented first and the next word is 
added andthe chunk is played. The program gradu- 
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ally builds up the chunk until the selected chunk 
is complete. For example, if the selected chunk 
is “Xavier attended the international Children’s 
Conference,” the program presents them with: 


Xavier 

Xavier attended 

Xavier attended the 

Xavier attended the international 

Xavier attended the international Children’s 


Xavier attended the international Children’s 
Conference 


It offers them an opportunity to concentrate on 
rhythm and intonation but in a different way from 
the pattern that is presented with back chaining. 
This may assist the learners to listen to different 
aspects of the language chunks which may result 
in better perception. Renard (1975) also points 
out that the build-up technique is very success- 
ful in raising the learners’ awareness of rhythm 
and intonation. 

In short, forward and backward chaining of- 
fer learners an opportunity to concentrate on the 
rhythm and intonation of the chunk. The chunk 
can be built up in two different ways: forward and 
backward. Learners can raise their awareness and 
concentrate on these important features, which are 
different from the ones in their mother tongue. 

In this program, it is recognised that while 
providing feedback is important, it might be 
necessary to prevent students from looking up 
the answers as soon as they encounter a difficulty 
with the clip. Therefore, when students first enter 
the main working page, the “Understand?” button 
is usually gray (see Figure 1) and the letters on 
the button are faint which indicate that the button 
is not currently usable. 
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The buttonis, however, automatically activated 
when learners select either Sound only, Video only, 
or Audio-visual by clicking the <Clip type> but- 
ton. When learners select a correct clip type and 
start playing the clip by clicking on the <Play> 
button, the letters on the <Understand?> button 
turn black, which means that the button is now 
active. Learners are expected to listen to the clip 
until at least a certain point has been reached 
before they can click on the button. 

The transcript box on the right hand side of 
the screen is then replaced by a square field with 
a prompt above it. Learners are expected to type 
their understanding of the listening clip into the 
square field. They can type in as many words or 
sentences as they wish. If they would like to re- 
listen to the segment over and over, they can do so 
by clicking on the <Replay> button repeatedly. 

After learners are certain about the listening 
clip, they may type in an answer in the square field 
and click on the <Submit> button to send their 


answers. The<Submit> button is then transformed 
into the <Continue Understand?> button. 

After the <Submit>button is clicked, the 
program provides learners with an answer to 
compare with their own answers. The answer is 
provided in a rectangular field below the square 
field. The rectangular field presents a prompt on 
the top: “Compare your story with the stories 
below. Replay the segment at will.” Learners 
should read the answer provided and compare it 
with their own stories. 

The procedure to utilize the <Understand?> 
button can be repeated any number of times until 
learners reach the end of the clip. However, if they 
do not want to continue the function, they can 
simply click on the <Quit> button, which brings 
them back to the main working page of the les- 
son. One of the most interesting characteristics 
of this program is that students can stop the file 
at any point, so they can explore any aspects of 
the language as they wish. 


Figure 2. A screen capture of the “Understand?” button 
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The program can also provide learners with 
a summary of the work of other students in a 
rectangular field. The comparison can easily 
be done because the summary of one learner is 
similar to that of another student. However, the 
program reminds them that the summary of other 
students may not always contain all the correct 
information. A warning message — “Thanks for 
your summary. The following summary is the 
other student’s summary. It might contain some 
correct and some incorrect points. Read it care- 
fully.” — appears on the top of the provided sum- 
mary. This is to remind learners that they have 
to be critical in reading the summary. 

The program does not provide a correct ver- 
sion of the summary. This is based on a belief, 
suggested by Lian & Mestre (1985), that if the 
learners are immediately givenacorrectsummary, 
their tensions and feelings of frustration might 
be reduced, but in addition will understand that 
only correct meanings are provided and then try 
to memorize the summary. In other words, they 
will stop listening actively, and this does notseem 
to be an appropriate way of dealing with spoken 
texts. When learners feel like doing more exer- 
cises, they click on the <Continue> button and 
are presented with the next exercise. The button is 
then transformed back to the <Submit> button. 

MMExplore also enables learners to record 
their voice and compare it immediately with that 
of the text being studied thus providing enhanced 
language laboratory functionality with the added 
advantage of being able to use any authentic text 
selected for inclusion in the system. 

Together, these support structures in MMEx- 
plore will ultimately lead not only to an aware- 
ness of communication at work but also to the 
development of enhanced self-awareness. Further, 
users of this program are catering to their own 
needs, motivations or preferences in ways which 
would simply be impossible in aregimented/text- 
controlled lock-stepped environment. In the next 
section, an experiment involving 20 students in 
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2003 at the Suranaree University of Technology 
(SUT) in Thailand is described. 


THE EXPERIMENT 


The program involved a group of 20 first-year 
English I intermediate level students of the 2003 
intake at Suranaree University of Technology 
(SUT) in Thailand. They used nine lessons in the 
program for 15 weeks in total with a week break 
towards the end of this period. The participants 
were from three different proficiency levels. Nine 
participants were from the high proficiency level, 
five were from the middle level, and six were from 
the low level. They were from four major fields of 
study, namely engineering, agriculture, informa- 
tion technology, and medical science. 

Before the start of the experimental period, 
a training session to introduce functions of the 
program was provided for the participants. All 
steps required for participating in the research 
project were clearly explained to them in Thai 
to avoid any confusion. They were notified that 
their participation in the project was not related 
to the English subject they were taking. They 
were informed that various forms of evaluation, 
both qualitative and quantitative, would be ad- 
ministered to observe effects of the program on 
their listening comprehension performance and 
attitudes towards the program itself. 

The participants were required to use the 
program at least four hours a week but the maxi- 
mum number of hours were not set. They could 
use the program in their own leisure time at the 
university’s English Language Resource Unit 
(ELRU). Ten computers were specially allocated 
for this project. As they were required to complete 
various kinds of materials for reading, grammar, 
vocabulary, and listening materials in the ELRU 
as part of the compulsory requirements for stu- 
dents enrolling in English I, it was convenient 
for students to use this program. They were not 
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disturbed while studying because the computer 
section was separated from the other sections. 
The researcher was always present to provide 
assistance to the participants. 


Evaluation Mechanisms 


At the end of the experimental period, five evalu- 
ation methods, namely English I examinations, 
pretest, and posttest of experimental group of 
students completing tasks while listening to clips 
via the program, log files of students’ usage of the 
program, questionnaire of their attitudes towards 
the program, and interviews of students, were 
analysed to ascertain the effects of the program 
on the learners’ listening comprehension. 


English | Examinations 


Listening comprehension was examined in the 
midterm and final examinations in the multiple 
choice format only. The participants were required 
to listen to several conversations and answer com- 
prehension questions by ticking the correct choice. 
The tape was played twice in each conversation. 
The questions which dealt mainly with specific 
details of the listening clip, were written by ateam 
of the English I lecturers at SUT. The researcher 
was not involved in writing the tests. 


Pretest and Posttest 


The pretest and posttest used in this study were 
developed by the researcher so as to provide amore 
accurate gauge of improvement in listening skills. 
The tests measured how much the experimental 
group of students comprehended in terms of both 
global ideas and specific details after they listen 
to the clip. There were two types of task in the 
pretest and posttest: written and multiple choices. 
In the written task, the participants were asked 
to write down in English (or Thai) the global 
ideas and specific details of the listening clip. 


They could also provide the answers in a mixed 
format in response to being asked to describe the 
story. If they wrote down the global ideas and 
specific details correctly, they would receive one 
point for each piece of information. The scores 
of each participant were then added according to 
the categories of global ideas (GI) and specific 
details (SP). This procedure was carried out in 
both pretest and posttest. 


Log Files 


The purpose of electronically keeping track of log 
files was to discover the patterns of use for the 
program. Around 500 log files were created and 
recorded for the whole use period. The information 
in each log file included the names of the users, 
detailed information of the login time and date, 
the buttons that they utilized and the time they 
worked with each button, the chunks they selected 
oruse of the Right-click function, andthe answers 
they input into the program. All log files of all 
participants were carefully examined. 


Questionnaire 


The questionnaire was distributed to participants 
after the posttest. They were requested to fill out 
the questionnaire honestly and individually. Part 
one of the questionnaire collected personal infor- 
mation. Results showed that the participants were 
from a variety of backgrounds and represented 
different major fields and language abilities. They 
had been studying English for several years but 
most of them believed their skills in English, 
particularly listening comprehension, were at a 
low level. They also seemed to be familiar with 
learning English through memorizing vocabulary 
items and grammatical rules. 

Part Two of the questionnaire required the 
participants to rate their opinion towards the 
MMExplore. A five-rating scale, which ranged 
from Strongly disagree (1), to Disagree (2), Neither 
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agree nor disagree (3), Agree (4), and Strongly 
agree (5), was employed. There were 21 state- 
ments in this part. 


Interviews 


The purpose of the interviews was to cross check 
information from the questionnaire. It also aimed 
to obtain in-depth information that could not be 
covered in the questionnaire. Guiding questions 
were used in the interviews. Some impromptu 
questions were also used at the appropriate junc- 
ture in order to obtain more information. The 
interviews were tape recorded but the machine 
was placed out of sight to reduce any possible 
anxiety. 


RESULTS 
English | Examinations 


The scores of the English I Examinations provided 
an answer to the first research question: 


An Evaluation of a Listening Comprehension Program 


Using the non-participating students as 
the control, do participating students (the 
MMExplore group) appear to have achieved 
a greater comprehension of the video and 
audio as measured by marks gained in the 
“Listening” part of the midterm and final 
achievement examination in 2003? The 
answer is “Yes.” The mean score of the par- 
ticipants in the study was higher than that of 
the non-participating students in the same 
proficiency level. In the high proficiency 
level group the mean score of the non-par- 
ticipants was 10.00, but the mean score of the 
participants was 10.55. In the middle group, 
the mean score of the non-participant was 
7.85, and the mean score of the participants 
was 8.60. The same tendency appeared in 
the low proficiency group; the mean score 
of the non-participants was 7.00, while the 
mean score of the participants was 8.00 (see 
Table 2). 


For the final examination, the result of the 
statistical calculation showed the same tendency 


Table 2. A table summarizing the mean of the scores of the listening part in the midterm examination of 


students in EG and CG 


Group Mean of the scores of the participants / Mean of the scores of the non-participants 
in the study 

High 10.55 10 

Middle 8.60 7.85 

Low 8.00 7.00 


Table 3. A table summarizing the mean of the scores of the listening part in the final examination of 


students in EG and CG 


Group Mean of the scores of the participants | Mean of the scores of the non-participants 
in the study 
High 13.11 12.28 
Middle 9.40 8.40 
Low 10.00 7.31 
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that was revealed in the midterm scores. In the 
high proficiency level group the mean of the scores 
of the non-participants was 12.28, while the mean 
of the scores of the participants was 13.11. In the 
middle group, the mean of the scores of the non- 
participants was 8.40, whereas the mean of the 
scores of the participants was 9.40. The same trend 
wasalsorevealed in the low proficiency level. The 
mean of the scores of the non-participants was 
7.31, and the mean of the scores of the participants 
was 10.00 (see Table 3). 

The analysis showed that the participants 
made significant improvement in their scores in 
the final English I examination. It could be seen 
that the mean of the scores of all the participants 
was higher than that of the non-participants in the 
same proficiency level. The gainmade by the Low 
proficiency participating group was 2.69 points 
in the final examination. 


Pretest and Posttest 


In terms of the second research question: Using 
the participating students’ responses to listening 


tasks as measured by the global ideas (GI) and 
specific details (SP) written down in the written 
and multiple choice parts of pre-experimentlisten- 
ing test (pretest) as control, do the same students 
appear to have achieved greater comprehension of 
the video and audio as measured by the number of 
global ideas (GI) and specific details (SP) written 
down in both the written and multiple choice parts 
of a different listening test (posttest)? 

The results are also in the affirmative. The 
results revealed that in the pretest participants had 
a lot of difficulty in dealing with the task in both 
global ideas and specific details in both written 
and multiple choice questions. They hardly wrote 
down any global ideas, but some could provide a 
few specific details of the clips. In comparison, 
they performed better in the post-tests. All partici- 
pants tried to provide global ideas of the listening 
clip. All of them also submitted a great number 
of specific details in each clip. The willingness 
to provide answers was significantly different be- 
tween the pretest and posttest, as was the number 
of answers. Furthermore, they answered all the 
multiple-choice questions. 


Table 4. The comparison of pretest and posttest: Global ideas and specific details in the written task for 


the experimental group paired samples test 


| ttstst~—<itsSSSCsS Paired Differences 


Sig. (2-tailed) 


Std 
Deviation 


95% Confidence 
Interval of the 
Difference 


Pretest 

Total - Posttest 
GI Total 
Pretest SP 
Total - Posttest 
SP Total 


** significant at the level of 0.05 (2-tailed) 
Key: GI: global ideas 
SP: specific ideas 


Lower _ | Upper 
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Their pretest scores and posttest scores were 
compared by using the Independent-Samples 
T-test procedure (2-tailed) in all three aspects: 
global ideas, specific details, and multiple choices. 
In the case of the global ideas scores, the mean 
of the posttest scores was better than that of 
the pretest scores at a statistically significant 
level of p=0.002 (see Table 3). The mean of the 
global ideas pretest scores was also statistically 
significant with p=0.00. The mean of the global 
ideas posttest scores was 0.70 ideas on average. 
The participants did not receive any marks in the 
pretest, yet they were able to get some marks in 
the posttest. 

A similar tendency toward real improvement 
revealed itself in the comparison to the specific 
details pretest and posttest in the written task of 
the test. The results showed that the mean of the 
specific details posttest scores was better than 
that of the pretest scores at a statistically signifi- 
cant level of 0.00 (see Table 4). The mean of the 
specific details pretest scores was 1.10, while the 
mean of the specific details posttest scores was 
4.45. The participants seemed to improve greatly 
in grasping the specific details of the listening 
clips. Their scores were much higher in the post- 
test in this aspect. 


An Evaluation of a Listening Comprehension Program 


The last comparison was made between the 
scores of the multiple-choice pretest and posttest 
for the experimental group. A similar trend was 
found in the results. The mean of the scores in the 
posttest was better than that of the pretest scores 
ata statistically significant level of 0.00 (see Table 
5). The mean of the multiple-choice pretest scores 
was 5.10 while the mean of the multiple-choice 
posttest scores was 8.25. 

In brief, it could be observed that, overall, the 
participants’ scores were better in the post-tests 
than in the pre-tests. The improvements discov- 
ered in all three aspects of comparison were at a 
statistically significant level. This would indicate 
that the participants performed better in under- 
standing the listening clips in the post-tests than 
in the pre-tests. Their proficiency in listening 
comprehension seemed to have improved a great 
deal after being exposed to MMExplore. 


Log Files 


In terms of the third research question: What pat- 
terns of use can be found in the students’ usage of 
the MMExplore when a systematic examination 
of the electronic log files that kept track of student 
behaviour is undertaken? Common patterns from 


Table 5. The comparison of pretest and posttest in the multiple choice task paired samples test of the 


experimental group 


Paired Differences 


Sig. (2-tailed) 


95% Confidence 
Interval of the 
Difference 


Pair Pretest 


Mcq 
1 total - Posttest ae 


Mcq total 


** Significant at the level of 0.05 (2-tailed) 
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an examination of the log files collected from 
students’ interaction with the program are as 
shown in Table 6. 

Item 4 in Table 6 suggests that most students 
preferred to use the starred version. The ability to 
guess seems to be motivating. The ability to hear 
a particular chunk repeatedly, in different modes 
seem to be appreciated as this provides them with 
more opportunities to obtain low level specific 
details (indicated by item 5). However, students 
seemed to be preoccupied with transcribing 
each word correctly, not with understanding the 
meaning of the whole clip. This pre-occupation 
on the word level, as indicated by items 5 and 
7, is more worrying as it indicates that students 
did not use MMExplore to practice other higher 
level strategies (such as cognitive, meta-cognitive 
tactics) that might be useful in listening compre- 
hension. This tendency to stay on the word level 
is further reinforced by that fact that they did not 
record their own voices (item 9) nor did they try 


Table 6. List of behaviours tracked from the log files 


to transcribe the text by themselves without help 
from the starred version of the texts (item 10). 

Furthermore, the fact that they did not write 
extensive global ideas or summaries of the listen- 
ing clip suggests that these L2 students did not 
see the value of such activity. 

This might have an effect on the low improve- 
ment of their global ideas scores in the post-test 
because this exercise directly provided them with 
practice in using their high-level processing skills 
for extracting the global ideas. Therefore, when 
they faced the post-test, they were not successful at 
this skill. Although participants were more willing 
to provide answers than they were in the pre-test 
situation, their answers were not correct. 


Questionnaire 


The result of the questionnaire confirmed data 
contained in the log files and from the observations 
from the researcher. The moststriking result from 


1. Most students preferred to listen to the whole clip at the beginning of each lesson; 


2. The clip types frequently employed in listening were Audio-visual and Sound Only. 


types was not very high. 


3. Although other clip types such as Noisy and Filtered were selected, the frequency of selection of these clip 


4. The listening process was usually carried out with the starred version of the text instead of the text version. 
Participants preferred to use the stars in helping them comprehend chunks. 


5. The ability to listen to a particular chunk also seemed to be very much appreciated. They always selected 
chunks and listened to the slow version and normal version of the chunk. 


6. Most of them listened to a large chunk first; listening to them first at normal speed and then at a slower 
speed. Then they transcribed a small chunk inside the chunk originally selected. 


7. Most of them tried to transcribe most words in the transcript by working on it little by little. 


8. They frequently used the exercises at the end of each lesson to test their understanding. 


9. Only a few participants used the recording function to record their own voices. 


than trying to transcribe the text by themselves. 


10. Students preferred to see everything on screen such as provided by the starred version then guess rather 


11. Most of the participants did not provide complete answers exercises which required them to type in 
global ideas of the listening clip. They tried to provide only a few sentences. 
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the questionnaire comes from students’ answers 
to statement 21 which asked them to agree to the 
statement: “I have used the program more often 
than this study required.” Twenty-five percent 
strongly disagreed; 35 percent disagreed, and 
30 percent neither agreed nor disagreed. Only 5 
percentt strongly agreed and agreed. The fact that 
MMExplore did not enthuse students to use the 
program more often beyond what is expected by 
the study signifies an important area for further 
research, that is, how do you motivate students to 
improve their listening comprehension skills when 
learning English as a foreign language especially 
when students are unlikely to have easy access 
to native speakers of English? 


Interviews 


The results showed that the participants had a 
positive attitude towards MMExplore. Most of 
them believed that the program was useful and 
helped improve their listening comprehension. 
Majority of the students unfortunately still viewed 
grammatical rules as important as demonstrated 
by their frequent request for grammar feedback 
every lesson. 

The cause of low frequency of use was due to 
the students’ heavy studying schedules. Also they 
preferred to focus on their normal schedule and 
other core subjects such as physics and chemistry 
first. Some of them revealed negative attitudes 
towards learning English including English lis- 
tening comprehension. They felt that they would 
not need good listening comprehension skills in 
their real lives as their contacts with English na- 
tive speakers were likely to be limited. 


CONCLUSION 


From the available data, it could be argued that the 
MMExplore helped to improve students’ listen- 
ing comprehension. Participants achieved better 
scores in general listening comprehension marks 
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in the final examination than the non-participat- 
ing students. In the global idea section, however, 
the improvement was significant although lower 
than the improvement when compared with their 
scores in writing down specific details. 

The majority of the participants also demon- 
strated positive attitudes towards the program 
in terms of content, usefulness, and structure. 
Most believed that the program helped improve 
their listening comprehension. However, the pat- 
terns of behaviours shown in the log files suggest 
that designers of Computer Enhanced Listening 
Comprehension programs have to face several 
challenges: 


1. How do you motivate students to improve 
their listening comprehension skills when 
learning English as a foreign language es- 
pecially when students are unlikely to have 
easy access to native speakers of English? 

2. | What other measures can be built into the 
program to get students away from being 
fixated on vocabulary and grammar points, 
and guide them towards writing down more 
global ideas thus employing more high level 
learning strategies? 

3. | What can be done in order to promote the 
usefulness of the voice comparison? 


On a curriculum design level, this study was 
designed as a stand alone mechanism to improve 
L2 students’ listening comprehension skills. The 
trend of L2 students’ pre-occupation with low level 
production tasks on the word level suggests that 
to fully maximise the potential of MMExplore, 
such a multimedia tool should also be part of the 
general curriculum design and should be used in 
the classroom as well as in self-accessed study. For 
instance, the need to practice higher level strate- 
gies and how to practice those strategies should 
be demonstrated by teachers so that students will 
seize the opportunities provided by the various 
tasks in MMExplore to approach listening com- 
prehension using an unfamiliar path. Information 
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contained in the log files of this study has already 
informed us of specific problem areas in the way 
L2 students complete listening comprehension 
tasks. Feeding such information back into stu- 
dents’ normal English classroom activities would 
improve their autonomous usage of MMExplore 
by providing them with a new set of behaviours 
to employ in their self-access learning. 

In conclusion, this study clearly demonstrated 
that a Computer Enhanced Language Learning 
program, such as the one being evaluated, can 
greatly facilitate the training of listening com- 
prehension in a learning English as a foreign 
language context. The freedom this program af- 
fords students means that motivated students can 
choose to work with this program at any time and 
choose any path to work on in the program. The 
fact that most students did not venture too far away 
from their comfort zone, that is, they focussed 
on words, vocabulary, and grammar, points to a 
need for much research in the area of curriculum 
design. The results of this study provided proof 
that MMExplore can improve students listening 
comprehension ability in English even though the 
sample size here is rather small. However, the gains 
in the students’ proficiency proved that Computer 
Enhanced Language Learning programs such as 
this one, can play avery importantrole in language 
acquisition and learning. 
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KEY TERMS 


Cognitive Load: The internal system which is 
employed in the listening process is fairly limited 
and plays a very important role in the success or 
failure of listening comprehension. 


Cognitive Tactics: Any mental process which 
learners make use of in language learning such as 
inferencing, generalization, deductive learning, 
monitoring, and memorizing. 


Perception: The recognition and understand- 
ing of events, objects, and stimuli through the use 
of senses (sight, hearing, touch, etc). 


Stress-Timed Language: A languagein which 
the stressed syllables are said to recur at equal 
intervals of time. 


Syllable-Timed Language: A language in 
which all syllables are said to recur at equal 
intervals. 


Thai Tones: There are five distinctive tones 
(pitches) in Standard Thai. They are: (1) mid 
level tone (here represented with the number 
1), for example: khaal (to be lodged in); (2) low 
level tone (represented with the number 2), for 
example: khaa2 (Galanga, an aromatic root);(3) 
falling tone (represented with the number 3), for 
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example: khaa3 (I, slave, servant);(4) high level 
tone (represented with the number 4), for example: 
khaa4 (to sell); (6) rising tone (represented with 
the number 5), for example: khaa5 (leg). Thai 
language is a syllable-timed language in which 
syllables are said to recur at regular intervals. 
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Section III 


CMC and 
Language Acquisition 
and Learning 


The chapters in this section concerns the use of computer-mediated communication for language learning 
purposes. Starting with a chapter on how to effectively design tasks that maximizes student engagement 
in the learning process, chapters on the implementation of CMC in various contexts are then presented. 
Then, it ends with a study that aims to address the problem of serial monologues in student online dis- 
cussions and participation. Research reported in this section suggest that though CMC is very useful 
for language acquisition and learning, the role of the teacher is still essential. 
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Chapter XVII 
CMC for Language Acquisition 


Terence C. Ahern 
West Virginia University, USA 


ABSTRACT 


Authentic experiences encourage the student to cognitively engage the content by actively trying to make 
sense and to integrate the experience. This chapter describes a range of currently available and emerg- 
ing mediated communication technologies for supporting both didactic and constructivist approaches 
to language acquisition. Even though CMC has several unique characteristics that make it suitable for 
designing authentic instructional experiences but as the research indicates, using CMC effectively re- 
quires careful consideration of the intended discourse goals. Through collaborative discourse, student 
and teacher engage the content and incorporate it into their cognitive repertoire. These activities are 
discursive in nature, writing, verbal interaction, and presentation. Consequently, this chapter discusses 
how to effectively choose the CMC software most effective for epistemic engagement. 


INTRODUCTION 


Numerous studies and reports have documented 
the tremendous increase in the development 
and delivery of instruction through the use of 
network-based technologies. Warschauer (1997) 
remarked 10 years ago that this rapid growth 
“arguably the fastest growth of any technology 
in history has caught the attention of language 
teachers” (p. 470). In fact, colleges and universi- 
ties have enthusiastically embraced these modes 
for delivering instruction which has resulted in 


a transformation as Larreamendy-Joerns and 
Leinhardt (2006) observe “distance learning and 
teaching have moved from the periphery to the 
center of university life” (p. 570). 

There has also been a tremendous amount 
of research conducted during the past ten years 
investigating the delivery of instruction (See Tal- 
lent-Runnels, Thomas, Lan, et al., 2006) using 
online technologies. One clear trend from all of 
this research is that the delivery of online instruc- 
tion has embraced a variety of different delivery 
models, theories, and philosophies. According to 
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Larreamendy-Joerns and Leinhardt (2006), these 
delivery models can be distilled into three major 
design views: presentational, performance-tutor- 
ing, and epistemic engagement. 

The presentational view makes use of multi- 
media for instruction that is delivered primarily 
through text, which integrates visual and aural 
experiences that “may be more appealing to 
students than printed materials” (Larreamendy- 
Joerns & Leinhardt, 2006, p. 585). In contrast, 
the performance-tutoring approach relies on the 
computer to provide adaptive individualized in- 
struction based on the student’s performance. This 
approach has a long history and is based on the 
premise that we “learn by doing” (Larreamendy- 
Joerns & Leinhardt, 2006, p. 587). 

Finally, Larreamendy-Joerns and Leinhardt 
(2006) identify a third approach, which they call 
epistemic engagement. This technique is depen- 
dent on using computer-mediated technologies 
to effect teacher-student and student-student 
interaction in authentic experiences. The idea is 
that “the learner engages in questioning, makes 
connections, draws inferences and validates 
learning” (Larreamendy-Joerns and Leinhardt, 
2006, p. 590) in an authentic context. 

This chapter is divided in two sections. The 
first section discusses authentic instructional 
experience and the process of epistemic engage- 
ment. Students who study a language are better 
equipped to encounter and to interact with other 
peoples by being sensitive to the cultural and 
social mores of this society. This acquisition is 
facilitated by a shift in instruction from abstract 
exploration of language to dynamic authentic 
experience. The second part reviews research 
on the use of computer-mediated communica- 
tions (CMC) technologies for engaging epistemic 
engagement along with a way of matching the 
most appropriate technology with the intended 
discourse goal. 
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AUTHENTIC EXPERIENCE 


An authentic experience is an instructional as- 
signment that has an intrinsic relevance. Ahern 
and El-Hindi (2000) write that: 


These environments create situations in which 
schoolwork is perceived as an authentic opportu- 
nity to engage a community of peers on issues of 
personal importance. Each student develops an 
awareness of authorship and the need for rhetori- 
cal competence. Consequently the student engages 
to inform, explain, persuade, or entertain based 
notonly on simple opinion but also on the rational 
development of an argument (p. 385). 


Any authentic instructional activities must, at 
aminimum, possess internal coherence and build 
on prior assignments. 

Authentic experiences also can be naturalistic 
and have external coherence to a student’s real 
world contexts or problems. Consider the situa- 
tion with airline pilots who train in flight simula- 
tors. This naturalistic environment allows them 
to experience real-world situations without the 
actual consequences. This allows them to learn 
from their mistakes and gives the student an op- 
portunity to reflect on their own performance, to 
test their understanding, and to draw conclusions 
on why any one particular solution is preferable. 
“Tt requires evaluation, not simply accumulation. 
Understanding results from the testing of theories- 
in-action, and the efforts of learners to reconcile 
their beliefs in the face of ever-changing experi- 
ence” (Hannafin & Land, 1997, p. 189). 

Authentic assignments require students to not 
simply react but to engage the content. As Wells 
and Chang-Wells (1992) observe: 


When students in school are encouraged to treat 
texts not as authoritative pronouncements but as 
contributions to an ongoing dialogue in which 
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they can be active participants in search for un- 
derstanding they will be more inclined to acquire 
the range of skills and strategies that are necessary 
for full participation (p. 144). 


Authentic experience encourages the student to 
cognitively engage the content by actively trying 
to make sense and to integrate the experience. To 
achieve this type of engagement is accomplished 
through epistemic engagement. 

Epistemic engagement as a form of instruc- 
tional delivery takes on “the vision of knowl- 
edge and learning as practices both within the 
structure of a domain and within a disciplinary 
community” (Larreamendy-Joerns & Leinhardt, 
2006, p. 590). The process to realize this vision 
is through discourse. Discourse creates meaning 
and understanding through the process of describ- 
ing, explaining, predicting, arguing, evaluating, 
explicating, and defining (Ohlsson, 1995). 


EPISTEMIC DISCOURSE 


Through collaborative discourse, student and 
teacher or student and student engage in an interac- 
tion that leads them to make meaning of the content 
and to incorporate it into their cognitive repertoire. 
These activities are discursive in nature, writing, 
verbal interaction, and presentation that “focus 
on knowledge and understanding, rather than on 
procedures” (DeVries, Lund & Baker, 2002, p. 
64). In other words “the medium for skill prac- 
tice is action while the medium for reflection is 
discourse” (Ohlsson, 1995, p. 39). The process 
of this understanding is cyclical and iterative. It 
contains three distinct but interdependent parts 
that depend on discourse: reflection, interaction, 
and dissemination. 

Anessential mechanism in the process of epis- 
temic discourse is reflection. During this stage, 
the individual is trying to identify an experience 
much like what a doctor does when engaging a 
patient. The goal at this stage is to try to make 


sense of an experience (Ahern, 2002). When we 
encounter a new situation or context, we react as 
Dewey (1991) suggests, in: 


(1) A state of doubt, hesitation, perplexity, diffi- 
culty, in which thinking originates and (2) An act 
of searching, hunting, inquiring, to find material 
that will resolve the doubt, settle and dispose of 
the perplexity (p. 9). 


Gardenfors (2000) concurs in that “the decision 
procedures that connect perceptions and actions 
must be created with the aid of the experience 
of the agent. To be useful the procedures should 
not only be applicable to known cases but should 
generalize to new situations as well” (p. 122). 
This implies that concept formation or learning 
is a process of reflection and recall. 

The agent in the new situation recalls the 
context of a prior but similar situation. Where 
the current situation and previous experiences 
intersect can be added to the concept as examples. 
Reflection typically leads to a process of self-ex- 
planation which Ploetzner, Dillenbourg, Preier, 
and Traum (1999) define as self-explanation, 
which is “an attempt to understand something (.g., 
instructional material) an individual might try to 
explain it to him/herself.... Self-explanations are 
frequently expressed silently” (p. 104). 

Reflection, discernment, and self-explanation 
are an individual’s attempt to create meaning 
through the filter of their private interior lan- 
guage in an attempt to integrate new experience 
into prior knowledge. However, each individual 
is limited in prior experience. Therefore, the 
individual seeks an authority in order to test or 
validate their understanding through interaction 
with an authority. 

Vygotsky’s research on the early use of lan- 
guage led him to discover what he termed the 
zone of proximal development (ZPD). This zone 
“defines development as the space between the 
child’s level of independent performance and 
the child’s assisted level of maximally assisted 
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performance” (Bodrova & Leong, 1998, p. 3). 
Therefore, novice or intermediate learners seek 
confirmation of their performance on some task 
or concept from an authority such as “Hey dad, 
am I doing this right.” Over time, the student is 
able to perform independently. So, as Bodrova and 
Leong (1998) observe, “as a new skill or concept 
is mastered, what a child can do one day only 
with assistance, soon becomes his or her level of 
independent performance” (p. 3). 

Festinger (1954) soon discovered that the need 
for “social approval” is a powerful force work- 
ing on both individuals and groups. According 
to Festinger (1954) “There exists in the human 
organism, a drive to evaluate his opinions and 
his abilities” (p. 117). Festinger outlines a social 
a mechanism where an individual “tries out an 
interpretation” through interactive dialogue. The 
basic principle is seen in young children where 
they seek approval from their mother by asking, 
“is this right?” 

This interaction is dynamic. An individual 
will seek out a group in order to test their under- 
standing or interpretation of an experience. Hand, 
Wallace, and Yang (2004) found in a recent study 
that “the majority of students attributed increased 
conceptual understanding to hearing their peer’s 
explanations and having an opportunity to share 
their ideas in the group, as evidenced by Rob and 
Else. Students attributed increased learning to the 
actions of both giving and receiving information” 
(p. 143). 

The process from reflection to interaction and 
from interaction to reflection is iterative. How- 
ever, there is a movement to domain authority, 
what Ohlsson (1995) identifies as the “epistemic 
activities” (p. 51). With domain authority, the 
student effectively explains, argues, critiques, 
defines, predicts, describes, explicates from a 
particular point of view, typically in a piece of 
writing in a document such as a paper or article. 
Within the texts they must demonstrate linguistic 
resources that: 
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Include an array of cohesive and interpersonal 
features, which help relate a text to its context 
by assisting readers to connect, organize, and 
interpret material in a way preferred by the writer 
and with regard to the understandings and values 
of a particular discourse community (Hyland & 
Tse, 2004, p. 157). 


Fundamentally, this is about the dissemination 
of knowledge to a specific knowledge community 
that helps sustain an ongoing discourse within 
that community. 

Through the process of reflection, interaction 
and dissemination, the student engages the con- 
tent in order to incorporate it into their cognitive 
repertoire. This discourse is epistemic. Therefore, 
the goal of instruction is to create authentic activi- 
ties that require the use of epistemic discourse. 
The anywhere-anytime flexibility of CMC has 
been cited as a major factor in creating authentic 
assignments in order to encourage and sustain 
epistemic activities in the classroom. 


COMPUTER-MEDIATED 
COMMUNICATION 


Computer-mediated communication (CMC) has 
been suggested as means to achieve a paradigmatic 
shift in instructional delivery especially for the 
language classroom (see Ahern & El-Hindi, 2000; 
Warschauer, 1997). 

Historically, computer-mediated communica- 
tion technologies have been referred to as though 
it was a “single medium” (Warschauer, 1997, p. 
472). However, a more realistic view of CMC is 
that it is a collection of different computer appli- 
cations engineered to meet specific discourse or 
rhetorical goals. Originally, e-mail and chat were 
the prevalent technologies as they were designed 
to mimic the postal service and the party line 
telephone service. 
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More recently, especially with the develop- 
ment of the Internet, there has been an explosion 
of new, emerging communication technologies 
ranging from blogs to wikis. These technologies 
have radically altered “how users view the nature 
of the written document. CMC has merged the 
immediacy of oral discourse with the permanence 
of writing where most “users expect computer- 
mediated text to perform as though they were 
engaging ina real-time, face-to-face interaction” 
(Ahern & El-Hindi, 2000, p. 388). 

However, because computer-mediated com- 
munication over the past 10 years has been rap- 
idly evolving, Romiszowski and Mason (2004) 
suggest that a better way to approach a definition 
of CMC is one that includes “both the delivery 
mechanisms, derived from communication theory, 
and the importance of the interaction of people 
that the technologies and processes mediate” (p. 
398). Understanding the functional (temporal and 
archival) as well as the social (exchange and audi- 
ence) characteristics of different CMC is essential 
to designing effective authentic experiences. 

A major hallmark of CMC is in its ability to 
remove the constraints of time and place. The 
asynchronous feature of CMC is definitely an 
advantage because it provides the ability to interact 
at any time from anywhere. Rovai (2002) states 
that “Research evidence suggests that for many 
students, ALN (asynchronous learning network) 
programs provide a high level of satisfaction, 
particularly regarding flexibility oftime and place 
for learning and the emphasis on interpersonal 
interaction” (p. 2). Additionally, CMC supports 
real-time, synchronous forms of interaction. Soft- 
ware, suchas instant messaging, allows real-time 
messaging to occur. Synchronous technologies 
create a strong network bond because each of the 
participants must be present at the same time in 
order to communicate. 

A second major characteristic of CMC is in 
its persistence. The ability to store an exchange 
provides a major functional advantage. Inarecent 


study the ability to access prior messages was 
essential to sustaining the group’s interaction. 
According to Ahern, Thomas, Tallent-Runnelset 
al. (2006) the “availability and access to a com- 
mon ground in computer-mediated discussion is 
necessary to sustain instructional interaction over 
the length of the discussion” (p. 45). 

Further, CMC demonstrates major social 
characteristics that can have important social 
consequences. Computer-mediated forms of com- 
munication support multiple forms of message 
exchange, ranging from one-to-one such as in 
e-mail or instant messaging to the one-to-many 
as found in online forums or blogs. CMC also 
supports a social experience where everyone is 
speaking at once, such ina large party. This form 
of exchange is difficult to sustain, but CMC is 
capable of supporting the many-to-many form 
of interaction through a wiki. 

Finally, CMC technologies provide users 
with the ability to engage in public or private 
exchanges. Individuals can exchange messages to 
one another privately. They can also post messages 
to public bulletin boards where anyone can read 
them. Also one unique feature of CMC allows 
users the possibility of having both public and 
private interaction simultaneously. For example 
while in a chat room, individuals can also carry 
on a private chat while continuing to engage the 
larger group. 


EPISTEMIC DISCOURSE AND CMC 


Computer-mediated communication appears 
to provide instructors opportunities to design 
epistemic engagement within authentic contexts. 
Students reflect on real problems with the oppor- 
tunity to integrate this new experience through 
engagement with their peers. The persistent na- 
ture of the medium makes this process iterative 
and allows them time to ponder the experience 
privately as well as collectively. The opportunity 
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that mediated technologies seem to provide in 
support of thought, talk and text is limited only 
by the design of the instructional context. 

However, research over the past 20 years on the 
use of different computer-based technologies to 
engage in cooperative, collaborative, and iterative 
interaction paints a different reality. In general, 
the use of CMC in the classroom specifically for 
epistemic engagement represents some outstand- 
ing successes as well as unmitigated disasters. 
The research shows that social interaction within 
a learning environment does not take place “just 
because an environment makes it technologically 
possible” (Krejins, Kirschner & Jochems, 2003, 
p. 336). Krejins, Kirschner and Jochems (2003) 
go on to say that there is a “paucity of theories, 
tools and cumulative results upon which to build” 
(p. 346). 

Successful use of CMC for epistemic en- 
gagement in authentic contexts requires careful 
design of the learning activity while choosing 
the most appropriate communication software as 
the delivery technology. One size does not fit all. 
There are numerous applications of CMC, each 
with different functional and social characteris- 
tics. Nonetheless, the truth of the matter is that 
teachers and students are remarkably adaptable 
and can effectively use any given technology if 
the learning activity is carefully designed. 

In any event the most important aspect for 
integrating CMC into the instructional environ- 
ment must provide is a sense of community. 
Many researchers have noted that a sense of 
purpose and community is probably the crucial 
piece to developing successful implementation. 
Rourke (2000) points out that “students need 
to trust each other, feel a sense of warmth and 
belonging, and feel close to each other before 
they will engage willfully in collaboration and 
recognize the collaboration as a valuable expe- 
rience” (“Operationalizing social interaction in 
computer conferencing,” para.2). Once they feel 
safe they are more willing to engage the content 
both privately and publicly. 
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The goal in epistemic engagement is for 
students to reflect, discuss and disseminate their 
understandings of an instructional activity in an 
authentic context. Even though research is mixed, 
there are some definite trends that provide insight 
and guidelines on how to design learning activities 
inorderto achieve an epistemic outcome. Research 
shows that “the relationship between the task and 
the delivery mediais not strictly neutral but exerts 
a reciprocal effect” (Ahern, 1996, p. 23). In order 
to maximize the epistemic engagement, both the 
discourse task and the delivery technology should 
be matched. 

Researchers studied the effect of the use of 
e-mail in as a tool on 12 classrooms in 10 elemen- 
tary schools (Van der Meij, de Vries, Boersma et 
al., 2005). What they found was that the students 
needed to compensate for the lack of interactional 
coherence by creating what the researchers called 
meta-tags. “Meta-tags resemble the explicit lin- 
guistic means used to fortify the bond between 
messages, only these tags do so within a message. 
Meta-tags thus strengthen the internal coherence 
of an e-mail” (Van de Meij et al., 2005, p. 422). 
The researchers knew that e-mail per se was not 
really designed for this type of dynamic discourse. 
They noted that “E-mail conversations can suffer 
from a lack of simultaneous feedback, reduced 
audio-visual cues and deficient turn-taking” 
(p. 418). Nonetheless, the students exhibited a 
remarkable ability and flexibility by developing 
their own work-around—a repair that made the 
tool perform better (see Winiecki, 1999). 

The results of the study by Van der Meij et al., 
supports the idea that there is a task to technology 
fit. Email typically creates a one-on-one, private 
asynchronous exchange and is a better fit for 
creating reflective discourse. This is one of the 
results of the study that the researches observed 
and noted that “e-mail use is a catalyst for reflec- 
tion. It provides a meaningful goal for reflecting 
upon one’s learning experiences as these reflec- 
tions yield the input for the e-mail dialog” (Van 
der Meij et al., 2005, p. 436 ). 
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Similarly, another study explored the use 
of a blog as a system for collaborative writing. 
Krause (2004) made a perusal of how teachers of 
writing were using blogs. Those findings “would 
suggest that many writing teachers seem to be 
using blog spaces as places to facilitate dynamic 
and interactive writing experiences” (Writing 
teachers using blogs?) 

Krause conducted a study using a graduate 
writing class. For the study he created a “collab- 
oratively written blog space was a small part of 
the class and described from the beginning as an 
“experiment” for me as a teacher” (Krause, 2004, 
“Beginnings of my ‘bad experiment’”) What he 
found was that the students did not use the blog 
as forum or bulletin board for conversational 
exchanges as intended. The blog was useful for 
individual short writing pieces but failed as a fo- 
rum for conversational exchange. From this study 
Krause (2004) concluded that blogs or similar 
Web applications such as “other electronic writing 
tools that foster discussion and interactive writ- 
ing, particularly e-mail lists, commonly knownas 
“listservs” (“Blogs as publishing space”) would 
have been a better match. 

The research shows that two design elements 
need to be considered in order to create a success- 
ful epistemic engagement. First, the instructional 
outcome must be clearly identified. Secondly, it is 
necessary to match the intended discourse with 
the most appropriate and available software. 


INSTRUCTIONAL DESIGN 


The anywhere-anytime flexibility of CMC is 
the primary component in creating epistemic 
activities in the classroom. The key to effective 
and appropriate design is to match the mediating 
technology with the intended discourse in order 
to realize intended learning outcome. Using the 
mediating tools of CMC, with an understanding 
of the intended discourse goals, results not only 


in achieving the intended learning outcomes but 
also in creating an epistemic culture of discourse 
within the classroom. 

Creating a culture of epistemic discourse 
within the classroom begins with a clear under- 
standing of the intended learning outcomes. Sec- 
ondly, in conjunction with the learning outcomes 
the designer must have a realistic understanding 
of what the students know prior to entry into the 
learning environment. By identifying the instruc- 
tional outcome in conjunction with understanding 
the current state of the learner, an instructor can 
design appropriate and authentic learning activi- 
ties so that the learner may integrate conceptually 
the new material. 

Choosing the most appropriate delivery tech- 
nologies is based on understanding the intended 
discourse goals. The instructor can array differ- 
ent delivery technologies ranging from e-mail, 
threaded-discussions, wikis, to blogs. These tech- 
nologies require individuals to interact, ponder or 
publish content in an iterative context. 

A starting point for the creation of authentic 
assignments is an understanding of the intrinsic 
qualities and the naturalistic intent of the task. The 
task builds recursively on previous assignments 
as well as emulating the real world problems and 
context. To achieve this goal, the instructor needs 
to create authentic assignments that stimulate the 
need to engage in epistemic discourse that is a 
natural result of using language to learn. 


SELECTING THE TECHNOLOGY 


More often than not, the choice of technology 
is done not by design but through convention or 
availability of a particulartechnology (see Van der 
Meij et al., 2005). However, Warschauer (1997) 
calls the various technologies ‘thinking devices’ 
that can generate new meanings collaboratively 
(p. 471). Therefore, identifying the specific epis- 
temic outcome of the intended instructional task 


301 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


results in a greater opportunity for epistemic 
engagement. 

CMC exhibits four essential characteristics of 
time, persistence, exchange and audience. How- 
ever, inmatching the most appropriate technology 
for instruction the archival and social characteris- 
tics are the most important. Taxonomy of choice 
is built by carefully considering the software’s 
ability for storage as it intersects with the social 
characteristics of the type of exchange. 

The first step begins with the archival nature of 
CMC. Persistence allows for the retrieval, revision 
and revival of previous thinking or interaction. 
Consider for example the dialogue journal where 
students keep a written communication with the 
teacher. Wang (1996) found in an earlier study 
that keeping a dialogue journal using e-mail was 
“fast, fun and convenient” (Wang, 1996, p. 6). 
The students wrote more often and more freely. 
The teacher reported that the ability to reference 
prior writings was an extremely very useful 
feature. Wang and Fix (2005) write that “asking 
students to blog daily as a part of blending learning 
strategy can assist them in taking a critical and 
reflective stance toward instructional modalities 
and informational sources ” (p. 7). The ability to 
reconstruct dialogue is also very useful for peer- 
to-peer interaction. Threaded-discussions manage 
the interaction and allows for the reconstruction 
of the flow of ideas over time. Lapadate (2002) 
observes “The ability to craft meaningful contri- 
butions to the online discussion is enhanced by 
the permanent transcript of the conference that 
is automatically created. Participants can, at their 
leisure, look back at the record and selectively 
read and re-read sections” (p. 8). 

The social characteristic of the exchange is 
the next critical component in choosing the most 
appropriate software. Understanding the exchange 
of adiscourse is fundamental to such experiences 
writing inajournal. If the exchange is one-on-one 
exchange with the teacher the e-mail is a superior 
choice. However, by adding additional recipients, 
a blog would a better choice. 
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Theuse of epistemic discourse inthe classroom 
practically dictates that the nature of the exchange 
be asynchronous. Garrison (2003) writes: 


In contrast to the spontaneous verbal commu- 
nication of face-to-face learning contexts, the 
asynchronous and largely written communication 
of asynchronous online learning would appear to 
provide the conditions that encourage if not require 
reflections. In addition to providing time to reflect, 
the permanent and precise nature of written com- 
munication also allows if not requires reflection 
to interpret and construct meaning” (p. 4). 


The key to selecting the most appropriate tech- 
nology is to first design an epistemic discourse 
environment, then choose the mediating technol- 
ogy by focusing on the taxonomy of choice per- 
sistence, exchange, time and finally the audience. 
There is no single CMC technology that meets all 
of the functional and social requirements of each 
form of epistemic discourse. It is incumbent on 
the instructor, developer or educator to mix and 
match the most appropriate technology for the 
given epistemic activity. 


A DESIGN SCENARIO 


The following scenario consists of a high school 
French 1 class. These students are typically 
American whose only language experience is 
their native English. 

The goal for Unit 2 is for the students to 
learn: 


How to talk about people and objects using mas- 
culine and feminine articles and nouns, as well as 
various forms of adjectives. You will learn how to 
talk about ownership by using the verb avior (to 
have) (Valette & Valette, 1990, p. 92). 


The unit activity is: 
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For the students to learn about French teenagers, 
their pastimes, the parties they organize and the 
town they live in. 


The activity is for the students to write in 
French: 


1. Ashort biography of ateenager from France 
or Canada 
2. An autobiography 


Creating an authentic assignment for this unit 
is built around understanding the instructional 
goal and the prior knowledge of the students. The 
students for this example are beginning French 
students who have been exposed to an introduc- 
tory unit for approximately four weeks. In order 
to turn the final activity into an authentic activity, 
the instructor can integrate the Internet along with 
targeted CMC technologies. 

Theinstructor might first establish a WebQuest 
(Dodge, 2006) that identifies the relevant original 
newspaper accounts of a French teenager from 
France or Canada. For the next part of the lesson 
the instructor would have each student use a blog 
forreflection. Each student wouldread the various 
newspaper accounts in French and then using their 
French language skills post a reflection on the 
grammar, content, word usage, and the like. 

Now the instructor could establish small 
groups of 3-5 members from the class. Each 
group would have a threaded-discussion board 
where the members could interact with each other 
in French—ask questions about the text, gather 
information on the task—and test their knowl- 
edge and understanding. They would interact 
using the threaded-discussion to negotiate on 
how they might design the final biography. For 
example, they may want to collaborate by writ- 
ing the bibliography together whereas in a more 
cooperative format each individual is responsible 
for a certain section of the final document. The 
ability to interact online would be essential for 
them to sort this out. 


Using a wiki would be the best choice for 
writing the biography because each of the small 
groups would have control over the final format. 
For the individual biography the blog would be a 
good vehicle for writing a biography. 

This authentic assignment hasan added benefit. 
Each student, because of the persistence of the 
tools used, has a resource that they can tap into 
during subsequent lessons and units. Further the 
instructor has an opportunity to intervene at any 
point during the assignment in order to make sure 
the learning object for the unit is mastered. 


SUMMARY 


This chapter explored use of computer-mediated 
communication for authentic instructional experi- 
ences. As the research indicates, implementing 
this type of technology in designing authentic 
experiences is not a trivial exercise, but rather 
requires a careful consideration both of the soft- 
ware and learning outcomes. Computer-mediated 
technology is nota single software application but 
many technologies that possess both functional 
and social characteristics that govern its design 
and impacts the effective deployment in the 
classroom. By critically considering the inher- 
ent characteristics of CMC software language 
instructors can design for a culture of epistemic 
engagement. 
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KEY TERMS 


Authentic Assignment: An authentic as- 
signment has internal coherence with previous 
assignments. They may also be naturalistic in 
which students explore real-world problems and 
situations. 


Blog: A personal publishing application where 
users can post text on the Internet. 


Chat: Allows individuals to engage in syn- 
chronous interaction with other individuals or 
groups. 


CMC: Computer-mediated communication 
is software that supports text-based interaction 
through network computers. 


E-mail: A networked application that is 
designed to exchange messages between indi- 
viduals. 


Epistemic Discourse: Epistemic discourse 
creates meaning and understanding through 
the discourse process of describing, explaining, 
predicting, arguing, evaluating, explicating, and 
defining 


Epistemic Engagement: A form of instruc- 
tional delivery that engages practices both within 
the structure of a domain and within a disciplin- 
ary community 
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Forums: Forums, threaded-discussions, or 
bulletin boards are forms of asynchronous con- 
versational interaction. It is marked by short, 
frequent exchanges. 


Wiki Wiki: Gives users the ability to easily 
edit a Web page. What emerged was a form of 
multi-user collaboration. 
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Chapter XVIII 
A Task-Based Design for 
Integrating E-Mail with 
FL Pedagogy 


Shannon Johnston 
The University of Queensland, Australia 


ABSTRACT 


Atask-based approach to e-mail provides a sound pedagogical orientation for real language interactions 
between learners and native speakers. The literature suggests that e-mail-oriented tasks are important 
for successful e-mail experiences (e.g., as evidenced in Kung, 2002; Muiller-Hartmann, 2000) and de- 
mands a greater pedagogical role for e-mail (e.g., Marcus, 1995; O’Dowd, 2004; Warschauer, 1995). 
Nunan’s concept of task-based teaching (2004) appropriately links e-mail and pedagogy. This chapter 
presents a discussion of e-mail tasks within the Nunan task-based framework, and follows it with evi- 
dence from a study of tasks in senior secondary Indonesian as a FL classes in Queensland, Australia. 
With this proposal, the author hopes to inform teachers, and stimulate research of task-based e-mail as 
a pedagogically rigorous teaching method. The impacts of context and a teacher’s personal theories on 
outcomes are areas requiring further research attention. 


INTRODUCTION 


E-mail is best for connecting language learners 
in all parts of the world (Brammerts, 1996); al- 
lowing teachers to provide experiences that take 
communication beyond the classroom (Jiang & 
Ramsay, 2005) and into native speaker communi- 


ties (Kung, 2002; Mathiesen, 1993). Experienc- 
ing communication by e-mail and thus using the 
target language motivates learners (Ho, 2000; 
Warschauer, 2001), enhances language knowl- 
edge (Li, 2000; Stockwell & Harrington, 2003; 
Tella, 1992), and develops cultural knowledge and 
understanding (Fischer, 1996; Liaw & Johnson, 
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2001; Miiller-Hartmann, 2000; O’Dowd, 2003). 
However, e-mail key-pal exchanges in the style 
of pen-pals are likely to be “a very empty and 
frustrating experience” (Nagel, 1999) and not 
likely to work (Fischer, 1998). Such pedagogi- 
cally weak e-mail exchanges can also lead to loss 
of learner interest and involvement (Liao, 1999; 
Warschauer, 2001), missed learning opportunities 
(Fischer, 1996; Ware, 2005) due to such factors as 
intercultural clashes (O’ Dowd, 2003; Ware, 2005), 
and early cessation of e-mail conversation threads 
(Stockwell, 2003; Stockwell & Levy, 2001). 

Contemporary views on effective practice of 
ICT in foreign language classroom contexts hold 
that increasing the interaction between learn- 
ers’ e-mail practices and teachers’ pedagogical 
practice is imperative (Cooper & Selfe, 1990; 
Nagel, 1999). However, increasing the teaching- 
learning-e-mailing interaction is only one step 
towards improving the effectiveness of e-mail for 
language learning. Marcus (1995) advocates that 
e-mail for language learning needs sound peda- 
gogical practice that is underpinned by relevant 
theory. The research field is limited by the lack 
of research developing and investigating e-mail 
with sound pedagogical practice and theory. 

As well as proposing a task-based approach 
for a pedagogically sound practice for e-mail, 
this chapter addresses a lack of research that 
acknowledges e-mail as an integrated part of the 
teaching methodology and the curriculum which 
itserves. In Queensland, Australia, teachers teach 
both the lower secondary and senior secondary 
syllabuses. The lower school foreign language 
syllabus is task-based, while the senior second- 
ary curriculum is methodologically eclectic but 
includes tasks for effective classroom practice. The 
task-based teaching approach for e-mail thus is 
not only relevant to e-mail, but is applicable and 
potentially beneficial for implementing e-mail 
in the Queensland senior secondary Indonesian 
syllabus. 

This chapter reviews the e-mail literature to 
demonstrate the increasing interest in tasks and 
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role for pedagogy in enhancing the e-mail expe- 
rience presents a task-based approach to e-mail 
through matching Nunan’s approach to task-based 
teaching with examples of tasks in e-mail literature 
demonstrates the approach with evidence from a 
classroom-based research study. 


THE BACKGROUND 


Classroom-based research of e-mail shows posi- 
tive outcomes for second language acquisition in 
non-teacher-intervention applications. Stockwell 
and Harrington (2003) found qualitative and quan- 
titative evidence of syntax and vocabulary devel- 
opmentin learners who shared e-mail exchanges in 
the target language, Japanese, with native speaker 
university students in Japan for five weeks. These 
findings support claims that e-mail provides rich 
input (Aitsiselmi, 1999) determined a necessary 
condition for language acquisition in Krashen’s 
input hypothesis of language acquisition (1982). 
However, there have also been warnings that e- 
mail can provide inappropriate input—too easy or 
too difficult for learners—and thus does not aid 
language learning (Fischer, 1996; Woodin, 1997). 
Li’s (2000) findings that e-mail tends to develop 
students’ richness and complexity of language use 
butnot necessarily their accuracy also suggests the 
input theory for supporting e-mail in classroom 
contexts is inadequate. Swain’s (2000) suggestion 
for “collaborative dialogue” in asynchronous ex- 
changes, supported by O’Dowd and Eberbach’s 
(2004) proposal for developing student ability with 
dialogicratherthan monologic participation, tends 
to an interactionist understanding of the role of 
e-mail for language learning (also see Stockwell 
& Harrington, 2003). 

More prolific attention has been to e-mail for 
learning about the target culture. Although much 
literature has assumed that e-mail is a chance 
for learners to develop cultural understanding 
via ask-and-answer searches for cultural ‘facts’ 
about the target country from the perspective 
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of native speaker key-pals (¢.g., see Ho, 2000; 
Liaw & Johnson, 2001), more recent studies 
e-mail challenge that assumption. Investigating 
breakdowns in communication through cultural 
clashes and subsequent missed learning oppor- 
tunities (0’Dowd, 2003; Ware, 2005) has found 
that e-mail provides the opportunity to enhance 
not only learners’ cultural awareness, but also 
their intercultural communication skills (Furst- 
enberg, Levet, English, & Maillet, 2001; Kern, 
1996; Kung, 2002). 

Attention has also been paid to limitations 
to learning from e-mail exchange participation 
due to the above-mentioned lack of purpose, 
under- or over-challenging language levels, and 
intercultural clashes, as well as Stockwell’s (2003) 
study investigating the effects of early cessation 
of topic threads on language learning (Stockwell 
& Levy, 2001). These limitations could be ad- 
dressed by implementing pedagogical support for 
e-mail exchanges. Stockwell suggests extending 
conversational threads to enhance rich input and 
interaction for greater development of language 
acquisition through the kinds of topics required 
or suggested by teachers (Stockwell, 2003; 
Stockwell & Levy, 2001), enhancing intercultural 
learning through in-class attention to messages 
and classroom activities for promoting particular 
skills or knowledge (Fischer, 1996; Leahy, 2001; 
O’Dowd & Eberbach, 2004), aligning e-mail 
with pre-existing curricular focuses (Greenfield, 
2003; Miiller-Hartmann, 2000), or setting tasks 
for particular learning objectives, for example, 
collaborative learning (Furstenberg et al., 2001; 
Kung, 2002). 

Attempts to improve pedagogical roles have 
often applied a task-as-topic concept of tasks. 
More significant have been studies that give more 
purposeful characteristic to tasks. These include 
tasks for preparing learners with something pur- 
poseful to discuss in their e-mail interactions, 
such as completing a survey about stereotyping 
(Keogh, 2001), reading and discussing literary 


texts (Ho, 2000), reading a published work and 
viewing author interviews (Kern, 1996), or view- 
ing movies (Fischer, 1998). Other tasks occur 
at the end of the e-mail interaction process, for 
instance, writing an essay or article (Jor & Mak, 
1994), or developing Web sites (Belz, 2002; Ho, 
2000). Collaborative and cooperative e-mail 
tasks have also been devised where learners at 
a distance complete a task together using e-mail 
as the medium of communication: for example, 
learners of French across the USA collaborated 
over a semester to produce a magazine (Barson, 
Frommer, & Schwartz, 1993), and learners in 
groups with native speakers completed a number 
of tasks with increasingly demanding collabora- 
tion—choosing a group name, writing a group 
story, and writing an academic essay (Kung, 
2002). Although, these applications did not make 
use of the opportunity for integration between 
curriculum objectives and plans, pedagogical 
activity and the use of e-mail. 

Pedagogic-e-mail integration allows for class- 
room focus to give context and purpose to e-mail 
interactions, and for e-mail interactions to extend 
classroom and curricular learning. O’ Dowd (2003) 
developed 10 weeks of discrete class and e-mail 
activities with the intention of guiding learners to 
pay attention to different aspects of intercultural 
communication and develop an appreciation for 
differences when communicating with native 
speakers by e-mail. Examples of each kind of 
activity are presented in Table 1. 

In addition to the classroom-e-mail link, 
Greenfield (2003) and Miiller-Hartmann (2000) 
extended learning by adding a final, synthesising 
task. In Greenfield’s case “an anthology of student 
writing was cooperatively planned, negotiated, 
and carried out by Hong Kong and Green River 
students” (2003, p. 48). The anthology was the final 
task ina series of classroom and e-mail tasks and 
activities. Following a number of in-class games 
and activities to enhance learners’ skills with 
cooperative learning, process writing and discus- 
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Table 1. Samples of O’Dowd’s class tasks as pedagogical task and enabling activities for e-mail tasks 
(2003, p. 123) (© 2003, Robert O’Dowd. Used with permission.) 


PEDAGOGIC/CLASS TASKS 


E-MAIL TASKS 


Class e-mail activity 
Discuss the image of Spain abroad 
with class peers using e-mail. 


Key-pal e-mail activity 


: Introduce self to key-pal and tell 


partner what differences expected in 


' partner’s home town. 


Class discussion activity 

Discuss word associations of key 
“cultural” words, e.g., “good food” in 
class. 


Key-pal e-mail activity 


: Compare own reactions with key-pal 
| partner’s reactions. 


Out-of-class research activity with 
class discussion 

Visit local tourist shop, discuss 
findings in class. 


sion and negotiation (see pp. 49-50), the learners 
completed a series of teacher-directed e-mail 
tasks, including e-mail icebreakers, essay writing 
with key-pal peer feedback, and production of the 
anthology through collaboration with key-pal. 
Also at school level, Miiller-Hartmann’s learners 
examined literary texts in class, developed their 
understanding of the texts further through e-mail 
discussions, developed their understanding of 
e-mail texts through class activity, and then syn- 
thesized the learning outcomes from all activities 
in a written product, such as a newspaper article 
or book critique. 

This discussion demonstrates that research- 
ers are exploring the concept of pedagogical and 
curricular integration, as well as goal-oriented, 
purposeful applications of e-mail. The approach 
mentioned in the following brings these two 
facets together. 
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: Key-pal e-mail activity 
| Tell key-pal what was in the shop, and 
: give personal opinion of accuracy of 


the representations of own culture. 


THE PEDAGOGICAL DESIGN: 
TASK-BASED APPROACH TO 
E-MAIL 


Task-Based Approach to Language 
Teaching 


A task-based approach to e-mail that is based ona 
task-based approach to language teaching givesa 
theoretically supported pedagogical frame which 
cohesively links the various elements that exist 
across different e-mail studies and strengthens 
the design for learners and learning. Task-based 
approaches (e.g., Nunan, 2004; Skehan, 1996; 
Willis, 1996) share common characteristics: 
they are goal-oriented, focus on meaning and 
negotiation, allow opportunity to focus on form, 
stimulate old/prior knowledge, and thus support 
related SLA theories. Nunan’s (2004) approach is 
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adopted by this study because it presents a view 
of tasks that links classroom language learning 
activities to real-world needs of learners. 

Nunan’s approach to task-based teaching com- 
prises learners completing real-world target tasks 
that are supported by a learning process of learn- 
ing tasks, activities and exercises. The underlying 
principle is that language teaching needs to provide 
real life target language interaction experiences. 
Providing real life tasks such as e-mail interac- 
tions alone is a beginning, but as the literature 
above demonstrates, learning requires a degree 
of focus. Nunan’s task-based teaching emphasises 
the importance of ‘pedagogical tasks’ and ‘en- 
abling activities’ in task-based language learning. 
Pedagogical tasks enable learners to ‘rehearse’ 
the target task or to ‘activate’ particular language 
and communication skills. Nunan classifies other 
classroom activities and exercises that develop 
language or communication skills as ‘enabling 
skills.’ Figure 1 charts the interaction between 
the different tasks and activities/exercises. 

A key feature of enabling skills and all task- 
based approaches to language teaching is focus 
on form. Focus on form is the conscious and 
deliberate attention to grammar that differenti- 
ates task-based teaching from other forms of 
communicative teaching methods. Criticisms of 
the communicative methodologies have centered 
on the lack of attention to form (Cook, 2001), and 


the observation that while “learners are able to 
acquire linguistic forms without any instructional 
intervention, they typically do not achieve very 
high levels of linguistic competence from entirely 
meaning-centered instruction.” (Ellis, Basturk- 
men & Loewen, 2002, p. 241). This observation is 
also supported in research on language learning 
arising from e-mail exchanges, where Li (2000) 
found that learners develop richness in language 
use but insignificant gains in the developing lan- 
guage accuracy. Focus on form as an approach 
to developing language accuracy in language 
teaching (e.g., Long, 1991; Long & Robinson, 
1998; Swain, 1998) addresses this observation, 
and task-based approaches to language teaching 
attempt to deal with limitations in the communica- 
tive approach by including focus on form. 


Task-Based Approach to E-Mail 


A task-based approach to e-mail in classroom 
contexts both responds to developments in e-mail 
literature towards tasks to support quality e-mail 
interactions and the understanding of task-based 
language teaching. This task-based approach 
requires learners to use e-mail in ways that are 
purposeful and goal oriented and incorporate 
focus on form practices—interaction between 
learners’ real-life communication and teachers’ 
pedagogical support. The aim is to enhance the 


Figure 1. Nunan’s tasks in task-based language teaching (2004, p. 25) (© 2004, Cambridge University 


Press. Used with permission.) 
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potential for learning from e-mail interactions. 
Tasks promoted in e-mail research provide abroad 
range of examples that can be presented in support 
of Nunan’s task-based teaching approach. 


Real-World Tasks 


Engaging in e-mail correspondence with a native 
speaker is in itself a real-world task: when cor- 
responding by e-mail, learners are involved in 
real and purposeful use of language. However, 
in educational contexts, other goals are deemed 
necessary for ensuring continued, quality e-mail 
exchanges that promote desired learning in lan- 
guage classrooms. Examples of real-world tasks 
with e-mail available in the literature include 
e-tandem learning. Learners correspond to learn 
about each other, and to help each other learn. With 
the notions of autonomy and reciprocity, e-tan- 
dem participants determine their own curricular 
needs and negotiate with their key-pal partners 
for meeting those needs, essentially become each 
other’s language tutor. E-tandem learning is most 
prevalent in Europe (e.g., Brammerts, 1996, 2003; 
Kotter, 2002). 

Harris (1998) presents three kinds of activ- 
ity: interpersonal communication, information 
gathering and analysis, and problem-solving. 
Designing a purposeful task involving these 
learner actions brings e-mail communication to 
focus onsome other goal, andthus giving purpose 
to the exchanges. 


° Collaborative tasks: Barson et al. (1993) 
reports on learners of French at different uni- 
versities collaborating to create amagazine. 
Kung (2002), whose learners collaborate to 
produce a group name, fictional tale, and 
academic essay. 

. Synthesizing tasks: Derived from Bloom’s 
(1956) educational taxonomy, these tasks 
involve learners applying the experiences, 
knowledge and skills they gain through 
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e-mail tasks and activities and associated 
classroom activities to create a new product 
in the target language. Miiller-Hartman’s 
(2000) coordinating perspectives are an 
example of the synthesizing task concept: 
after in-class reading activities and associ- 
ated e-mail discussions, learners in differ- 
ent school projects wrote book critiques 
or essays about an aspect of the readings, 
collaboratively wrote an ending to a short 
story, or created and compared findings for 
a questionnaire relating to an issue in the 
class/e-mail readings. 


Pedagogic Tasks 


Pedagogic tasks are the tasks carried out to support 
the real world task(s) selected by the teacher and 
develop skills necessary for the real world task. 
A number of decisions guide the selection and 
application of pedagogical tasks. Examples of a 
range of potential pedagogic tasks in the e-mail 
literature include: 


° Preparing learners for the kinds of activities 
that they will encounter, such as developing 
skills or awareness of process writing, team 
work, negotiation (Greenfield, 2003); 

° Developing learners’ understanding of lit- 
erary readings before they discuss certain 
issues raised in the readings with their key- 
pals (Miiller-Hartmann, 2000; Soh & Soon, 
1991); 

° Initiating awareness of intercultural issues 
to explore further with key-pals (O’Dowd, 
2003), for example investigating and dis- 
cussing stereotypical behaviors (Keogh, 
2001); 

. Reading texts, viewing video interviews with 
authors, and writing their own text, before 
discussing concepts further with key-pals 
(Kern, 1996). 
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Enabling Activities and Focus on Form 


Enabling activities involve class activity aimed 
at enhancing the learning for or from e-mail 
exchanges. Thus enabling activities can occur 
prior to the e-mail exchanges, in conjunction 
with e-mail activities, or after particular e-mail 
exchanges. Examples include: 


. Learners drafting e-mail messages and 
teachers correcting them before sending to 
key-pals (Tella, 1991); 

° Using e-mail to focus on particular gram- 
matical or cultural features: O’ Dowd (2003), 
Greenfield (2003), Chaffee-Sorace (1999); 

. E-mail as the learning resource/e-mail after 
the messages are exchanged: Fischer (1996), 
intentionally focuses on the messages re- 
ceived as a learning resource. 


Enabling activities not only focus on form, but 
also focus on other aspects of language learning. 
In the Fischer (1996) example just noted, he sug- 
gests teachers intentionally focus on the cultural 
images implicitin e-mail messages. This suggests, 
then, that intentional ‘focus’ on e-mail messages 
can be applied to aspects of language learning 
other than linguistic forms. O’Dowd’s example 
of a series of discrete tasks designed to highlight 
cultural perceptions in language and cultural ar- 
tefacts demonstrates that specific classroom and 
e-mail activities develop students’ vocabulary and 
intercultural language skills and knowledge. 


THE STUDY 


In a wider study considering educational context 
and teacher change as elements in implement- 
ing new technology, two teachers’ approaches 
to and experiences with e-mail in their practice 
were explored. For this chapter, the elements 


of the phenomenon relating to tasks have been 
extracted to illustrate the phenomenon of ‘task’ 
in real classroom contexts. 


Participants 


The participants in this study are two teachers of 
Indonesian as a foreign language in Queensland 
high schools—Carol and Sharon (pseudonyms 
are used)—and their senior secondary (year 11 
and 12) classes. The classes were small—seven 
students in Carol’s combined year 11/12 class and 
11 students in Sharon’s Year 11 class (Seven in 
the second year of the study). Carol participated 
within one school year and Sharon over two with 
the same students. The students were typical, 
urban-rural English-speaking females who had 
studied Indonesian since grade 6, and their schools 
are typical non-metropolitan, large co-educational 
state high schools. The students of Indonesian 
exchanged e-mail exchanges with Indonesian 
native speaker students in Indonesian senior 
schools learning English. They were to write 
the same amount (approximately a paragraph) in 
both Indonesian and English. The participating 
students in Indonesia came from schools identified 
in an earlier pilot study conducted by Hoven and 
Crawford (2001) as having established, working 
equipment and interested staff. The decision for 
senior secondary students is based on pragmatic 
factors—of government schools, only senior high 
schools had computer facilities 

There were several decisions made about the 
nature of the students’ e-mail exchanges, which 
form assumptions about the nature of e-mail in a 
classroom context. These assumptions were not 
explored, although they are worthy of research 
in their own right. These decisions are: 


. Students to write a ‘chunk’ in each language, 


with 100 words being proposedasa guideline 
for the chunk; 
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. Students to write in both their own language 
and their target foreign language in each 
e-mail message; 

. Students would write weekly. 


RESEARCH METHODOLOGY 


The doctoral study from which this chapter is 
derived applied a phenomenological approach 
and multiple data sources to the investigation. 
Researcher notes (documents presenting under- 
lying task-based approach to teachers, e-mail 
correspondence and telephone conversation re- 
cords), teacher and student questionnaires, teacher 
in-depth interviews and student e-mail messages 
were gathered to develop an understanding of the 
experience and the meaning of that experience 
for teachers. This understanding was developed 
through a tapestry of data analysis, and process 
of reflection through writing and re-writing as 
characteristic of phenomenological research 


Table 2. Teacher questionnaire content 


(Moustakas, 1994). For this paper, I address only 
data related to task-based teaching. 

The questionnaires were designed to stimu- 
late teacher reflection about the key processes 
in the implementation process, from which the 
interviews were used to “put flesh on the bones 
of questionnaire responses” (Bell, 1987, p. 135). 
The pre-project questionnaire aimed to ascertain 
teachers’ personal and professional prior experi- 
ences with technology (through ‘tick-the-box’ 
closed-answer lists), with e-mail in particular, 
and their expectations of e-mail for them and 
their learners (through open-ended responses. A 
concurrent aim was to raise teachers’ awareness 
of their pre-project perspectives and to evaluate 
their prior experiences briefly. The post-project 
questionnaires were designed to go through a pre- 
determined range of factors concerning e-mail 
in classroom practice. Questionnaire sections 
are listed here. 

Questions aimed to require closed responses 
where possible: yes/no, likert scale, select appro- 


Pre-e-mail Stage 


Section Subsection/topic 

Section E-mail within language course 

Logistics Computer and e-mail facilities 
Setting up e-mail partners 

Section 2 


Preparing students to e-mail 


Preparing for tasks 


Section 3 
E-mail Stage 


Exchanging e-mail messages 


Focusing on e-mails 


Section 4: 
Post e-mail Task 


Nature of task 


Section 5: 
Evaluation 
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Pre-interview reflection 


Professional impact 
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priate answers, but with frequent opportunities to 
elaborate. Furthermore, each section asked teach- 
ers to evaluate that section—what they would do 
again and what they would do differently. In her 
second questionnaire/interview process, Sharon 
was also asked to evaluate the actual outcomes 
of her proposed changes to practice from the first 
questionnaire. 

The interviews focused on adding depth toboth 
closed and open responses, clarifying meaning, 
and exploring issues opened up by the question- 
naire responses. The interviews were extremely 
valuable in fulfilling the phenomenological 
experience and “understanding the experience 
of other people and the meaning they make of 
that experience.” (Seidman, 1991, p. 3). This was 
particularly so regarding the issue of tasks. For 
instance, through the interviews, the teachers both 
expressed strongly their perspective that the task- 
based approach, particularly synthesizing tasks, 
did not meet with the compulsory institutional 
syllabus requirements for assessment. In discuss- 
ing the task issue, teachers’ varied meanings 
attached to ‘tasks’ in a senior secondary context 
emerged. For example, Carol often referred to 
e-mailing alone as a task, being satisfied that 
just by exchanging e-mail messages the students 
were meeting the new syllabus requirement for 
task-based learning endeavors. She also referred 
to single-skill activities, such as speaking or 
writing tests as tasks: “The kids ... thought they 
were improving their speaking skill. . They saw it 
as a speaking task ...” In addition, both teachers 
referred to the “topics” as tasks, such as Sharon’s 
“youth culture” and “festivals and celebrations” 
topics. The depth to the issue concerning tasks 
inatask-based approach to e-mail was developed 
through elaborating on the task section of the 
questionnaire, to gain an understanding of tasks 
and the teachers’ understanding of tasks which did 
not emerge through the questionnaire assumption 
that tasks in a task-based approach were planned 
for the e-mail experience. 


Student questionnaires, student e-mail messag- 
es, and the researcher documentation all provided 
additional data to confirm, verify, or question the 
teachers’ responses in their questionnaires and 
interviews. The student data particularly enhanced 
the e-mailing experience (sections 1, 2, 3 of the 
teachers’ post-project questionnaires), andas such 
were less meaningful to the task-based focus of this 
chapter. Researcher records of e-mail, telephone, 
face-to-face meetings, and other documentation 
provided records that supported or added to the 
teacher claims. 


THE CASE STUDIES 


Two case studies, one each for Carol and Sharon, 
were developed through arepetitive process of data 
reflection. The questionnaires were used to create 
a draft description of the e-mail experience from 
the teachers’ reflections, and gaps in the data and 
areas worthy of more in-depth exploration through 
the interviews were identified. The interviews 
were reviewed according to the questionnaire 
sections, and then added to the descriptive sto- 
ries of teacher experience. Emerging key issues 
and teacher claims were then explored through 
the student questionnaires and e-mail messages. 
This process gave light to, for example, the re- 
alization that the lack of e-mail messages from 
Indonesian key-pals and their tendency to write 
in English (student and teacher claims) which thus 
precluded effective post-e-mail synthesizing tasks 
(teacher claim) was found to some extent also to 
be a characteristic of the Australian students’ e- 
mail messages. Frequently messages mentioned 
upcoming holidays, or apologies for not writing 
due to exams. Students also tended to write shorter 
messages and several students would write more 
often in English than Indonesian. 

From these case studies, the following findings 
and discussion regarding the notion of a task-based 
presented above were extracted. 
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FINDINGS: E-MAIL AND TASKS IN 
CONTEXT 


Carol: Integrating E-Mail, Pedagogy, 
and Curriculum 


Carol responded to e-mail in her practice by creat- 
ing anew formal work unit in her work plan (her 
teaching program for the subject derived from the 
official syllabus), which was then approval by the 
Senior Secondary Indonesian Review Panel. The 
work unit, titled “Ayo ke Warnet” (Let’s go to the 
Internet café), focuses on the informal commu- 
nication of personal letters, e-mail, diaries, and 
telephone conversations and covers appropriate 
structure and organization of texts, language use, 
and sociocultural features of these genres. The 
classroom focus includes enabling activities and 
exercises such as investigating sample texts and 
focusing on language, and pedagogic tasks where 
learners practice the various discourse types inthe 
safe context of the classroom, such as exchanging 
e-mail messages with each other and the teacher. 
Evidence in students’ e-mail messages to key-pals 
towards the end of the unit and after indicates that 
they transferred the language of informal/personal 
letters to the e-mail context as intended by the 
pedagogic design, such as: 


. Conventional letter-writing addresses in 
their initial correspondence: Kepada sahabat 
e-mail yang baru[To my new e-mail friend], 
Kepada siswa-siswi yang baik [Dear kind 
students] 

. Conventional letter openers—greetings, 
health enquiries and thanks: Halo dan apa 
kabar? [Hello and how are you?], Terima 
kasih untuk e-mail mu [Thank you for your 
letter] 

. Conventional letter closing remarks: salam 
hangat [warm regards], salam sejahtera 
[prosperous regards], terima kasih atas 
perhatian dan e-mail Anda [thank you for 
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your attention and e-mail], sampai di sini 
dulu ... lain kali disambung lagi [that’s all 
for now, next time I’1] continue on]. 


After the completion of the Ayo ke Warnet work 
unit, Carol used e-mail to enhance class learning 
in other work units for information-gathering and 
rehearsing classroom-based language develop- 
ment in ad hoc ways as opportunities arose. For 
example, in the final work unit for the period of 
this study, poetry, politics and religion, Carol took 
advantage of an unexpected event,the first of the 
Bali Bombings in 2002, to link the unit with cur- 
rent affairs, to teach a range of functions listed 
in the syllabus (namely expressing sympathy, 
expressing emotions, and seeking information), 
and to have learners apply the functions inthe real 
context of e-mail communication. This resulted 
in rich e-mail-pedagogic integration: classroom 
enabling activities were combined with e-mail as 
a pedagogic task (developing skills, enhancing 
knowledge) and also a real-world task in the form 
of interpersonal communication on matters of 
shared experience (Australians and Indonesians 
involved in the bombings) and mutual interest in 
the welfare of the other. These examples from 
student e-mail messages applied the functions and 
awareness developed from class enabling activi- 
ties in real-world interpersonal communication 
withtheirkey-pals (‘E’ refers to the e-mail message 
coded by number, names are pseudonyms). 


Saya banyak sedih mengenai bomb di bali!! Saya 
harap anda lebih aman dari bomb di bali! Dan 
tidak ada orang anda tau luka. (Erica, E8) 

[I am very sad about the bomb in bali!! I hope 
you are safe from the bomb in bali! And there is 
no-one you know who is wounded. ] 


Saya harap kamu dan keluararga kamu lebihaman 
dari bomb di Bali. Itu takut sekali. (Mary, E4) 
[I hope you and your family are safe from the 
bomb in Bali. It’s very scary. ] 
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Bagaimana keadaan di Bali? Saya harap keluarga 
Anda dan kawan-kawan Anda sehat, senang and 
anan. Di Australia, ada banyak cerita dari surat 
kabar dan berita tentang keadaan di Bali. Ada 
kira-kira tiga puluhorang Australia yang mening- 
gal karena letus mobil. Juga, ada banyak orang 
di seluruh dunia yang sekarang merasa sedih. 
Tapi saya harap keadaan di Bali akan menjadi 
senang. (Melanie, E4). 

[How is the situation in Bali? I hope that your 
family and your friends are healthy, happy and 
secure. In Australia, there are many stories from 
newspapers and TV news about the situation in 
Bali. There are approximately thirty Australians 
who died because of the car bomb. Also, there 
are many people all over the world who now feel 
sad. But I hope the situation in Bali will become 


happy.] 


Carol also allowed the outcomes of discussions 
to be used as content in an in-class essay-writing 
test. Unfortunately, due to the nature of formal 
assessment in the senior secondary syllabus as 
supervised, unseen, single-skill (writing only, 
no reading or other communication skill) it is 
outside the definition of meaning-negotiated, 
goal-oriented, purposeful language task as de- 
fined above. Yet, it did give additional purpose 
to learners’ e-mail messages as they tried to 
enhance their understanding by communicating 
first hand with others from a different culture 
about the event. 


Sharon: E-Mail as Curriculum 
Pedagogic Task 


In Sharon’s view, tasks were not possible as part 
of the learning-assessment structure of the senior 
secondary syllabus, rather the value of e-mail was 
in the opportunity for independent language use 
by the students. The opportunity for e-mailing 
was important for the development of learners’ 
communication skills in Indonesian as well as 
the quality of learning from the experience of 


interacting with Indonesian native speakers their 
own age. Her initial purpose and process was to 
allow learners free communication, that is, e-mail 
itself as a real-world task. 

She found, though, as noted in other e-mail 
research that e-mail message-writing suffers from 
lack of purpose (e.g., Kern, 1996; Liaw, 1998). Her 
learners did not know what to write about or what 
they had the ability to write about (thatis, that they 
could transfer class learning to real communica- 
tion). From this, Sharon’s suggestions to learners 
lead to e-mail communication as a pedagogic task 
for class topics: she responded to the students’ 
questions of what to write about by suggesting 
topics of conversation which were past and current 
curriculum topics of learning. Later realizing the 
extended time frame between e-mail correspon- 
dence out, replies in, and extensive negotiations 
necessary for gathering appropriately in-depth 
information for supporting class learning, Sharon 
also suggested to her students that they pre-empt 
future curriculum topics by writing about them 
with key-pals. The students responded in their 
surveys that they preferred this combination of 
free topics and teacher allocated topics. 

Another way that Sharon gave purpose to e- 
mail correspondence was, after an initial period 
of e-mail communication, to select a global topic 
covering many curriculum topic areas: “youth 
culture.” At the end of the school year, learners 
wrote a short report on this topic based on content 
in their collective key-pal messages, their analysis 
of key-pals from the way they wrote and their 
e-mail messaging behavior, and class discussion 
of the same. E-mailing then had a purpose: a 
post-e-mail synthesizing task which concurrently 
supported the language curriculum. 

However, the students wrote in English. Sharon 
felt that writing in English would allow for more 
extensive reflections, considering their language 
skill level as year 11 students, but also they had a 
limited amount of time available due to impending 
class exams and the need to ‘finish’ the curricu- 
lum. In the second year, when the learners were 
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in year 12, she determined a new topic, reflecting 
on the e-mailing process rather than the content 
of the e-mail messages, and what they learned 
from their experiences. Once again, due to the 
complexity of the evaluation and the limited 
time available for tasks not directly impacting 
on required learning of the year 12 curriculum, 
the learners were to write their evaluations in 
English. In both cases, learners were involved in 
higher order educational actions of analysis and 
evaluation. It is unfortunate, due to pressures in 
the curricular context, that they did not have the 
opportunity to explore this in Indonesian. 


Contextual Limitations 


Both teachers experienced significant contextual 
limitations when attempting to implement e-mail, 
in particular e-mail tasks in their classroom cur- 
riculum and pedagogy. Acknowledging that these 
teachers’ approaches to and experiences of tasks 
occurred in situations that challenged how they 
conducted a task-based approach is important for 
understanding the approach to e-mail and task 
just presented. The teachers were commendably 
resilient and tenacious in working to promote 
interaction with native speakers in the light of a 
range of problems. 

The most visible problem was inadequate 
key-pal messages. Despite the earlier successful 
search for schools with facilities and interest, 
once the teachers and students tried to contact the 
schools for initiating e-mail message exchanges, 
there was no response. Once a school was found 
with a pro-active teacher and an agreement 
made about when to start, day and frequency of 
e-mail messages, and topics to discuss, within 
one month the e-mail messages from students 
in that school became infrequent, too short, and 
mainly in English. Sharon commented in her final 
questionnaire that: 


The messages received by my students weren't 
what I expected and were very brief and maybe 
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too ‘e-mail’ orientated which was [not] their 
learning requirement. 


The agreement was that students would write 
one paragraph (100 words) in each language in 
each message, but of the 27 Indonesian student 
messages received by Sharon’s students and seen 
by the researcher, only six messages had more than 
85 words in total—only two of these combined 
Indonesian and English in equal or significant 
amount. Eight messages had at least 10 words 
in Indonesian—five of these were at least half in 
Indonesian. Therefore, thirteen messages had no 
or less than 10 words in Indonesian. 

The students’ attempted to encourage their 
key-pals to write more in Indonesian (interest- 
ingly they made the request in English), as these 
extracts demonstrate: 


You should write part and only part of your letter 
in Indonesian so I can see how I go with it. (Irene, 
E2 Yr1—Sharon’s student). 

P.S Not only would I like to write to you in In- 
donesian but I would also enjoy writing a little 
in English (Bahasa Inggris) to perhaps help you 
develop your Indonesian! I look forward to hearing 
what you think! (Erica, E1—Carol'’s student) 


Aside from lack of e-mail messages from In- 
donesia, the students also noted that sometimes 
their key-pals would not answer their questions: 
“Most of the time they don’trespond, or if they do, 
they dont [sic] answer questions that were asked” 
(Ashleigh, Questionnaire2, Sharon’s student). For 
in-class tasks and activities requiring learners to 
gather information, lack of question answering is 
also problematic. This sample message exchange 
demonstrates both that the first student, Jody 
Brown, had not received a message from her key- 
pal for some time and was writing to stimulate a 
response from her key-pal, and second that her 
Indonesian key-pal, Adit, although he replied did 
not write in Indonesian andnor did he acknowledge 
her questions about the class topic, orangutan. 
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From: “Jody Brown” <e-mail here> 

Sent: Thursday, 31 October 2002 12:52 PM 

To: adit suryo 

Subject: Re: Why aren't you e-mailing me: ? 

Hi adit suryo, How are you? I haven’t heard 
from you in a while, are you alright? well at 
the moment my class and I are studying the 
orang-utans. We are going to go the university 
to get extra help. Well if you can help me with 
your knowledge on the orang-utans then please 
e-mail your information. E-mail me anyway 
to say hello. Please write to me very soon. 
From Jody 


From: adit suryo <e-mail here> 

To: “Jody Brown” <e-mail here> 

Sent: Tuesday, November 05, 2002 12:38 PM 
Subject: sorry........ 

Hi 

i’msorry because i’mlate to reply your e mail. how 
about your family I hope your family is fine i’m 
fine here.i have so many test this week how about 
you? I want to know about your family ?please 
reply me 


That key-pals had long periods without writ- 
ing, wrote short messages which lacked depth, 
and did not reply to topics of discussion raised 
by their Australian partners. These are the key 
factors stated by teachers why synthesizing tasks 
were impossible to conduct. However, not only 
were key pal partners’ message writing behaviors 
inadequate, there were a number of local issues 
that hindered with the Australian students’ ability 
to reply to partners in a timely way or develop 
in-depth e-mail messages. These include: 


. Inadequate facilities or access to facilities: 
Carol frequently had significant problems 
with classroom computers not working, or 
the Internet not working. Sharon had difficul- 
ties being timetabled into a computer room 
within the first few weeks of a semester, and 
then to having a computer room with func- 


tioning computers. Although the timetabling 
was made more equal across the school, she 
ended with a room with slow computers, 
some not working, and no printer. 

Loss of class time: Aside from losing class 
time trying to find working computers and 
Internet access, the teachers and students 
reported loss of class time due to school 
curricular events, such as assessment or 
exam periods: “Sometimes on the day we 
had an Indonesian exam, we wouldn’t get 
the chance to reply to our key-pals” (Davina, 
Questionnaire 1, Sharon’s student). In addi- 
tion, the school curriculum events—sports 
days, school photos, senior meetings, other 
excursions— and a range of other events 
promoted by the school administration or 
other subjects occurred in the class session 
that had been put aside for e-mail exchanges, 
and the loss of class time meant also a loss of 
e-mailing opportunity. Miss-matched holi- 
day and exam periods between Indonesian 
and Australian school systems also meant 
greater time between sending and receiving 
e-mail messages. 

Inadequate class time: In both cases, each 
Indonesian class was 35 minutes long. When 
problems occurred with the facilities in the 
session, Class time was lost to sort out these 
issues, and thus the actual time for e-mail- 
ing in a session was dramatically reduced. 
Carol’s students commented in their ques- 
tionnaires that there was “not enough time 
therefore restriction for writing” (Erica) for 
reasons such as “lesson time [was] needed 
more for exam preparation” (Bridgit), “We 
had to do other classwork (Kate),” and 
“rooms and time weren’t always available” 
(Mary). Both teachers allocated just one 
class session (out of five) per week to e- 
mailing, which is understandable as e-mail 
communication was essentially outside the 
formal curriculum (even with Carol’s Ayo ke 
Warnet unit the class work was the central 
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learning feature), but when that session was 
lost to other events, then students could not 
communicate for at least another week. No 
other time or home work was allocated to 
the e-mail experience. 


DISCUSSION 


The classroom investigations of teachers’ ap- 
proaches to e-mail and the task-based approach 
reveal that teachers conceive of pedagogic tasks 
in a two way flow, that is, pedagogic tasks in the 
classroom that support e-mail exchanges, and 
e-mail as a pedagogic task for enhancing class 
learning. Carol’s Ayo ke Warnet unit-of-work 
included enabling activities for developing stu- 
dents’ grammatical, lexical, and discourse knowl- 
edge for e-mail communication. Sharon’s global 
topic—youth culture—gave learners a guide and 
a purpose (writing a report) for the content of 
their e-mail messages. The interaction between 
class tasks and e-mailing, unlike other studies 
where the class tasks were directly related to the 
e-mailing tasks, showed e-mail was implemented 
within a curricular context. 

This study demonstrates that the curriculum 
context can guide and give purpose to the e-mail 
exchanges, such as when learners write about 
topics from the course curriculum. The curricu- 
lum context can also impede the implementation 
process when teachers are highly influenced by 
their need to assess and ‘finish’ the curriculum 
or the curriculum assessment conditions deter- 
mined that e-mail tasks could not be a part of the 
assessment process. Both of these impediments 
resulted in e-mail relegated to an extra activity, and 
curricular pressures meant teachers sometimes 
abandoned e-mail sessions. The school environ- 
ments were also influential in interrupting e-mail 
opportunities through difficulties accessing the 
facilities and interruptions from the school life 
events. This suggests e-mail in school contexts, 
being bound within curricular contexts, are subject 
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to the vagaries of those contexts, and innovative 
integration of e-mail, pedagogy and curriculum, 
through purposeful tasks are at risk. 

‘Innovative integration’ is of interest. The 
presentation of teachers’ use of e-mail and how 
that use matches with Nunan’s task types above 
demonstrates teachers at an initial stage of 
implementing technology according to the Apple 
Computers of Tomorrow (ACOT) study (Apple 
Computer Inc, 1995) adopting the innovation 
within current practice. These teachers did not 
adjust their practice to best meet the character- 
istics of e-mail communication. The curriculum 
in fact, appeared to restrict teachers’ perceptions 
of the ‘only’ ways e-mail could be used in their 
practice. Sharon maintained throughout the period 
of participation that e-mail was ‘an add-on’ to the 
official program, albeit in her view an important 
one for learners’ overall language experiences, 
and it was due to the her perception of the re- 
strictiveness of the senior secondary syllabus 
that it was an add-on. We have seen how Carol 
placed e-mail within a conventional work unit, 
developing knowledge through in-class enabling 
activities and pedagogic tasks. 

In past research, the introduction and use 
of e-mail has been represented as a static phe- 
nomenon. The teachers’ post-project interviews 
demonstrate that in reflecting on their experi- 
ences, the teachers articulated new awareness of 
e-mail as a classroom resource and the need to 
adapt their practice for more effective outcomes 
for e-mail. This includes how the teachers sup- 
port and prepare e-mail partnerships, how they 
apply e-mail messages as sources for classroom 
learning enabling activities, and in Sharon’s case 
new understandings both of tasks for e-mail and 
her perspective of designing for the senior sec- 
ondary syllabus. This finding suggests, in sup- 
port of general literature on educational change 
(e.g., Cuban, 2001), that teachers need both time 
and experience (Sandholtz, Ringstaff & Dwyer, 
2000; Zhao & Frank, 2003) to understand that 
new technologies require new understandings of 
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teaching, the nature of those new understandings, 
and awareness of what the new practice entails in 
their own particular pedagogical style, approach 
to curriculum, and personal theories of teaching 
and learning. 


FUTURE TRENDS 


Research about e-mail in foreign language school 
contexts has been increasingly attending to collab- 
orative and post-e-mail synthesizing tasks. This 
trend continues through this particular chapter, 
and further research is also necessary. This study 
highlights that while tasks are supported both 
in the literature and in the pedagogical design 
presented here, confounding factors indicate that 
further attention is needed to teacher change in 
becoming effective users of new technologies and 
to the curricular context and educational setting in 
which teachers work. Results of this study show 
that the teacher integrated e-mail and class work 
with pedagogic tasks and enabling activities at 
the stage of adaptation in the ACOT study stages 
(Apple Computer Inc, 1995). That is, they used 
e-mail in accordance with their current practice 
and carefully avoided e-mail interfering with the 
curricular design. Research needs to explore fur- 
ther the notion of teacher change within the real 
contexts of individual teachers in set curricula, 
rather than an idealized context as presented in the 
ACOT study and other studies that avoid attending 
to the problems encountered when implementing 
their e-mail projects. 

Research is also needed to investigate further 
innovative uses of e-mail within a set curricular 
context. It is necessary to bring e-mail research 
to the field of educational and curriculum change 
research, acknowledging the context of curricu- 
lum and educational setting, and addressing these 
internal issues so that teachers have the best chance 
for innovative and effective uses of e-mail tech- 
nology, or, indeed, any other ICT. Some research 
relating the implementation of educational tech- 


nology and contemporary trends in curriculum 
change and school reform exists (e.g., Zhao, Pugh, 
Sheldon, & Byers, 2002). However, there has been 
little research found that has viewed subject cur- 
riculum contexts, in school settings, and teacher 
change as being relevant to the introduction of 
e-mail into a learning context. 

Finally, in this international, intercultural, 
on-line collaborative venture between Australian 
and Indonesian teachers and students, there were 
tensions caused by different expectations of the 
venture and of the role of ICTs in high school peda- 
gogy. Furtherresearch of successful collaboration 
strategies in this particular intercultural setting 
will assist future attempts for communications 
technology in Indonesian learning contexts. 


CONCLUSION 


E-mail is an excellent tool that has the potential 
to bring classroom learning into the realm of real 
communication outside the classroom walls, and 
is supported by educational and language learning 
theory. However, efficient and effective learning 
comes from the opportunity to exchange e-mail 
messages, and clear, well-planned, pedagogical 
strategies that integrate e-mail into the curriculum. 
A task-based approach to e-mail gives purpose, 
educationally sound practice, and higher cogni- 
tive processing activity to e-mail correspondence 
between language learners and their native 
speaker key-pals. A new, sound pedagogical ap- 
proach, however, does not guarantee classroom 
success. This study indicates that, for teachers in 
ordinary classroom settings, applying e-mail in 
practice is challenging and complex. Successful 
integration of e-mail means a change in the way 
teachers approach their curriculum and practice, 
and requires openness and awareness of one’s 
curricular context and school environment, as 
well as particular characteristics of e-mail. E- 
mail correspondence in international collabora- 
tions needs teachers to be flexible and creative in 
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how tasks are conceived and implemented, and 
how they respond to expected and unexpected 
experiences that arise during the implementation 
process. Valuable intercultural learning opportu- 
nities can be lost by concentrating on what did 
not work as expected. 

The task-based approach presented here is not 
particular to e-mail communication between two 
individuals via computer networks. In fact, the 
task-based approach, the notions of teacher change 
and necessary attention to context, could be ap- 
plied with any ICT tool or combination of tools. Re- 
searching ICTs in task-based settings will enrich 
the soundness of this pedagogical approach. This 
chapter is about a sound approach, and perhaps 
from anon-technology-specific approach such as 
this, we can begin to address the problems with 
sound pedagogical practice in a world of rapidly 
changing technology where rapid technological 
change is the propensity for technology to appear 
to drive pedagogy (Patrikis, 1997). 
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KEY TERMS 


E-Mail: Electronic mail, asynchronous mes- 
sages exchanged via networked computers, most 
commonly the World Wide Web. 


E-Tandem Learning: Students learning each 
others’ languages who exchange e-mail messages 


in both languages and assist each other to develop 
their language communication skills. 


Focus on E-Mail: Focus on form is an SLA 
term for attention to grammatical forms in a for- 
eign language that arises in the context of carrying 
out other tasks, involves the practice of noticing, 
paying attention, creating hypotheses and test- 
ing these hypotheses in practice. In this chapter 
‘focus on...’ refers to applying the same practices 
with any aspect related to e-mail communication, 
for example linguistic, sociolinguistic, strategic, 
cultural, pragmatic, genre features. 


Foreign Language Context: Teaching and 
learning another language in a classroom context 
in an environment where the target language is 
not a common language of the community, for 
example learning Indonesian in Australia, and 
English in China. 


ICT (Information and Communications 
Technology): Computer-based technology that 
contains information and/or has electronic com- 
munication facilities, in particular Internet-based 
technologies. 


Key-Pals: E-mail correspondence partners. In 
this study key-pals refers to the student partner- 
ships, but there are also teacher partners that also 
act like key-pals. 


Pedagogy: Decisions teachers make and 
implement in carrying out formal and informal 
curricula in classroom practice. 


Task-Based Teaching: Orienting learning 
around tasks, and addressing language, commu- 
nication, culture and other relevant knowledge in 
the context of these tasks through other tasks or 
learning activities. 


Tasks: Real-world or realistic classroom 
endeavors that are purposeful, goal-oriented, 
student-centered and draw on language, com- 
munication, and cultural knowledge and skills 
for successful completion. 
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ABSTRACT 


In this chapter we analyze the role that error correction plays in fostering language development via 
e-mail tandem exchanges. In order to do so, we present the findings of a year-long e-mail exchange 
between specialist learners of English at Nebrija University in Madrid and non-specialist learners of 
Spanish at Trinity College Dublin during the academic year 2005-2006. Using the results of qualitative 
research, we present data from the students ’e-mail content regarding different aspects of error correction, 
such as type of corrections, conventions and use of metalanguage. The findings of this study suggest that 
corrective feedback, especially when it takes the form of remediation, can lead to language development 
in on-line exchanges since it encourages recycling of errors in later e-mail messages. 


INTRODUCTION 


In recent years, considerable amount of attention 
has been drawn to tandem exchanges for the 
development of learner autonomy (Appel, 1999; 
Little & Brammerts, 1996; Schwienhorst, 1997; 
Séntgens, 1999) and intercultural communicative 
competence (Stickler & Lewis, 2003; Vinagre & 


Lera, 2005; Woodin, 2001, 2003). The current 
study, however, will focus on e-mail tandem ex- 
changes as ameans of fostering language learning 
(Brammerts, 1996; Kotter, 2002, 2003 ; Little, 
Ushioda, Appel et al. 1999; Vinagre, 2005). 

As an ever-growing number of people around 
the world gain access to e-mail and Internet facili- 
ties, it has become clear that the communicative 
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environment provided by these tools can foster 
language learning. E-mail facilitates access to 
speakers of one’s target language. Such access 
is a crucial and an integral part of the language 
learning process. Environments which provide 
such access offer considerable potential for 
learning. The most important question we must 
now consider is this: How can e-mail tandem ex- 
changes be most fruitfully employed for language 
learning? According to Little and Brammerts 
(1996), there are three ways in which learners 
can improve their language skills with the help of 
their tandem partners: (a) by learning from their 
partners’ modeling; (b) by learning through their 
partners’ help in formulating, and (©) by learning 
through their partners’ corrections. 

In this chapter, we will explore this last aspect 
and, more specifically, we will focus on how 
tandem partners can contribute to each other’s 
second language development through the provi- 
sion of negative (corrective) feedback. In doing 
so, we present the findings of a year-long e-mail 
exchange between specialist learners of English 
at Nebrija University in Madrid and non-special- 
ist learners of Spanish at Trinity College Dublin 
during the academic year 2005-2006. 


TANDEM LANGUAGE LEARNING: 
THEORETICAL BACKGROUND 


Tandem learning has been the subject of much 
research over the last 40 years. Although its 
practice is well-established, what it entails is not 
always widely known exactly. The term tandem 
implies collaboration and simultaneity and, when 
applied to language learning, we refer to a part- 
nership between two learners who are learning 
each other’s mother tongue. These learners meet 
regularly and work together in order to achieve 
a two-fold objective: to improve their own com- 
municative competence in the target language 
and to help their partner achieve the same goal. 
Based on this definition, we can see that tandem 


learning rests on two main principles: reciproc- 
ity and autonomy (Little & Brammerts, 1996). 
The principle of reciprocity refers to the idea of 
exchange and, if this exchange is to be success- 
ful, there has to be a balanced partnership in 
which both participants benefit equally. Little and 
Brammerts (1996, p.11) define itas “the reciprocal 
dependence and mutual support of the partners.” 
Esch (1996) calls this principle “sharebility,” 
since it refers to two people who give and take 
in equal shares. The principle of reciprocity lies 
beneath the collaborative dimension of tandem 
learning, which is reflected in the partners’ mu- 
tual support, equal contribution, same extent of 
benefit and equal roles (as learners or experts). 
The principle of autonomy stresses that tandem 
learners are responsible not only for their own 
learning but also for that of their partners. As 
Little and Brammerts (1996) point out, “they 
alone [the learners] determine what they want to 
learn and when, and they can only expect from 
their partner the support that they themselves 
have defined and asked for” (p. 11). 

Leaner autonomy is defined by Little (1991) 
as a “capacity for detachment, critical reflection, 
decision making, and independent action” (p. 4). 
In his work on learner autonomy, Little (1991) 
takes into account various aspects of cognitive 
psychology that deal with active problem-solv- 
ing, development of new capacities for abstract 
thinking-learning and George Kelly’s (1963) psy- 
chology of personal constructs. In his theory of 
personal constructs, Kelly explains that: “Differ- 
ent men construe [the universe] in different ways 
(.. .) Some of the alternative ways of construing 
are better adapted to man’s purposes than others. 
Thus, man comes to understand his world through 
an infinite series of successive approximations” 
(p.43). 

This process of constructing the world is a 
“continuous process of hypothesis-testing and 
theory-revision” (Little, 1991, p.17). Our personal 
constructs are built mainly upon the shared system 
of beliefs and values that we acquire as members 
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of a particular society and culture. However, as a 
whole, they are unique to each one of us and we 
must constantly reshape our constructs in the light 
of new experience. As regards learning, personal 
construct psychology provides an insight into the 
bearing of each student’s own system of constructs 
on the learning task. Any learning task requires 
the student to assimilate new knowledge and, 
therefore, the student needs to constantly adjust 
and adapt. When this adaptation only requires 
a few changes in the already-existing personal 
constructs, learning takes place easily. However, 
if these adjustments entail a major restructuring 
of the underlying personal constructs, learning 
becomes difficult and, therefore, frustrating. 

In the field of foreign language learning, one 
consequence of Kelly’s (1963) theory would sug- 
gest that students should understand their own 
personal constructs if learning is to be facilitated 
emotionally as well as cognitively. This awareness 
may not be easy to achieve, in the same way that 
successful learning might not always follow. How- 
ever, if success in language learning lies mainly 
in an increased awareness of the learning process 
(internal cognitive aspect), learners must be active 
participants who take full responsibility for their 
own learning and they must also collaborate with 
others in solving problems and in restructuring 
their personal constructs through the making and 
testing of hypotheses. 

Another major influence on the concept of 
learner autonomy is provided by Vygotsky (1978), 
who reflects on the importance of social relation- 
ships to the development of learning. The central 
concept in his theory is “the zone of proximal 
development,” which can be defined as: “{. . .] the 
distance between the actual development level as 
determined by independent problem solving and 
the level of potential development as determined 
through problem solving under adult guidance 
or in collaboration which more capable peers.” 
(p.86) 

This approach stresses the crucial importance 
of collaboration (external social aspect) in the 
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learning process. Thus, interactive communi- 
cation should be facilitated through the use of 
alternative learner-centered environments where 
students can work together and help each other 
either in pairs or in larger groups. 

From the points previously discussed, one 
realizes that the internal cognitive aspect and the 
external social aspect of learning are inseparable; 
they are two sides of the same coin. They are in- 
tertwined in such a way that they cannot evolve 
independently. They influence each other and, for 
learning to take place, both aspects must develop. 
Thus, it is necessary for these two aspects to be 
considered when reflecting upon the principle of 
autonomy. The principle of autonomy is essential 
to the process of language learning since in order 
to achieve communicative efficiency in the target 
language learners must have “independence, self- 
reliance and self-confidence to fulfill the variety 
of social, psychological and discourse roles in 
which they are cast” (Little, 1991, p.27). 

One of the contexts in which this development 
of learner autonomy becomes possible is tandem 
learning by e-mail. In this type of exchange, stu- 
dents use the target language for the purposes of 
authentic communication with native speakers of 
their target language and they do so voluntarily. 
The relationship established between both par- 
ticipants, although based on power (learner/expert 
or non-native speaker/native speaker), does not 
remain static since the previously-mentioned 
roles are interchangeable which leads to a more 
balanced collaboration. Furthermore, the native 
speaker’s role is not to lecture on a series of 
grammatical or cultural issues; on the contrary, 
it is up to the learner to take advantage of what 
the native speaker has to offer as an expert in his 
own language and as a facilitator of the learning 
process. It is quite interesting to note what Appel 
(1999) writes in this respect: “for the exchange 
to be successful the learner needs a minimum 
of autonomy which will then further develop as 
a result of the exchange”(p. 14). Thus, tandem 
learning places participants in a feedback loop. 
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In this context, the more autonomous a learner 
is the more autonomous he becomes. 


ERROR CORRECTION AND 
TANDEM LEARNING 


Available research regarding error correction and 
its implications for second language learning is 
sometimes contradictory. Anker (2000) claims 
that “error correction remains one of the most 
contentious and misunderstood issues in the 
second and foreign language teaching profession” 
(p.20). Some studies on error correction men- 
tion that positive evidence alone is sufficient for 
adult second language learning (Krashen, 1977; 
1994); whilst others consider positive evidence 
as insufficient for second language learning to 
occur (Long, 1983, 1996). Positive evidence tells 
the learner which linguistic features in the input 
are possible in the target language whilstnegative 
feedback provides information about what is not 
possible in the target language (Morris, 2005). In 
regard to negative (corrective) feedback, whether 
it takes the form of explicit correction, recasts or 
negotiation of form, most studies seem to indicate 
that it facilitates the development of the learners’ 
second language (Chaudron, 1977, 1986; Lyster 
& Ranta, 1997; Lyster, Lightbown & Spada, 
1999; Morris, 2002, 2005; Myles, 2002; Panova 
& Lyster, 2002). Along the same lines, Hyland 
(1990) suggests that error correction, when car- 
ried out selectively, develops learners’ awareness. 
Bartram and Walton (1991) stress the benefits of 
peer correction versus teacher correction since, 
in their opinion, “the active involvement of stu- 
dents in the process of dealing with errors [...] 
stimulates active learning, induces a cooperative 
atmosphere, and develops independent learners” 
(p.81). Finally, according to Ancker (2000), teacher 
correction does not always work and, hence, the 
importance of peer correction for the development 
of language learning: “it helps to focus student 


attention on errors and to reduce reliance on the 
teacher, thereby encouraging student autonomy” 
(p. 23). 

In tandem language learning, error correc- 
tion has been identified as “the central overtly 
pedagogical element of a tandem partnership” 
(Little et al., 1999, p.39). It is also suggested that 
“.,. in naturalistic as well as in formal contexts, 
feedback is one of the most important stimuli to 
learning” (Little & Ushioda, 1998, p.96); “it is 
through giving feedback that learners’ metalin- 
guistic awareness is most tellingly sharpened and 
refined” (Little et al., 1999, p.52); “the subjects’ 
development of language awareness in an e-mail 
tandem exchange is due to a large extent to the 
feedback component” (Appel, 1999, p.34). Little 
and Brammerts (1996) suggest that error correc- 
tion can stimulate language developmentalthough 
learners’ opinions about the usefulness of the 
feedback that they receive from their partners are 
inconclusive (Kotter, 2002). Finally, analyses of 
synchronous and asynchronous network-based 
discourse (Barker & Kemp, 1990; Dam, 1995; 
Kelm, 1996; Warschauer, 1996a, 1996b; Schwien- 
horst, 1998) have demonstrated that students who 
are used to collaborative activities tend to be more 
receptive to receiving feedback, which, in turn, 
can foster language learning. 

The most detailed study on language learning 
in tandem via e-mail to date is Little et al. (1999). 
The authors carried out a linguistic analysis of 
approximately 200 messages exchanged between 
24 students and their partners over aseven-month 
period. As regards error correction, the provision 
of corrective feedback featured prominently in 
the induction sessions for their students and was 
encouraged as a means to promote language 
learning. Despite this emphasis on correction, 
the authors mentioned that there were “very few 
indications that any corrections were picked up 
or recycled in the course of the exchanges” (Little 
et al., 1999, p.48). 
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In addition to the findings of the above-men- 
tioned studies, e-mail tandem learning presents 
certain features that make error correction an 
essential factor for language development. First, 
the principles of autonomy and reciprocity that 
underpin tandem learning also underlie cor- 
rective feedback. The principle of autonomy is 
reflected in the fact that students make decisions 
concerning their own learning and, therefore, 
negotiate all aspects of error correction, such as 
how to correct each other, how much to correct 
and what to correct. The principle of reciproc- 
ity lies behind the mutual support the partners 
offer each other and is reflected in the partners’ 
acknowledgment of each other’s learning needs 
and styles in addition to providing corrections 
and offering encouragement. 

Second, we need to consider the communica- 
tive interaction itself. E-mail exchanges are text- 
based and computer-mediated. Both define the 
nature of the interaction between participants. On 
the one hand, the permanence of written texts (as 
opposed to oral speech) means that the messages 
can be analyzed again and again thus facilitat- 
ing reflection and raising language awareness. 
As Schwienhorst (1998) suggests, “The major 
advantage of written communication is “... the 
possibility for each learner to preserve the entire 
communication ...” and to have, for future use, 
“an enormous sample of his or her own efforts in 
the target language” (p.125). On the other hand, 
e-mail asynchronicity allows participants time 
to compose their messages and think about their 
answers, which also encourages critical reflection. 
These last two aspects (the permanence of written 
texts and e-mail asynchronicity) are of particular 
relevance when it comes to analyzing the role of 
error correction in tandem learning exchanges. 
Thus, corrections provided by one’s partner can 
be preserved for later reflection and, at the same 
time, asynchronicity allows corrections intandem 
to take three forms: correction, feedback and 
remediation (James, 1998). 
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PROJECT DESCRIPTION AND 
PARTICIPANTS 


During the academic year 2005-2006, we imple- 
mented an e-mail tandem exchange between 
10 specialist learners of English who studied 
advanced English as a compulsory subject at Ne- 
brija University and their counterparts at Trinity 
College Dublin who were non-specialist learners 
of Spanish and studied beginner’s or intermediate 
Spanishas an extra-curricular or optional subject. 
The purpose of this exchange was to promote 
autonomy in the language learning process in 
order to make the students aware of the impor- 
tance of being responsible for their own learning 
and that of their partners. In addition, we sought 
to promote language learning through authentic 
communication with native speakers. 

The students at both universities were given 
the same general guidelines explaining the im- 
portance of reciprocity and mutual help for the 
success of the exchange on e-mail tandem learn- 
ing (see Appendix 1). Furthermore, otherrelevant 
aspects were addressed: e-mail frequency (two 
per week), topics to be discussed and tasks to be 
carried out jointly. E-mails were to be written 
half in English and half in Spanish and students 
were given specific guidelines with regard to er- 
ror correction (See “How to correct your partner’s 
writing” in Appendix 1). 


RESEARCH QUESTION AND 
DISCUSSION 


Given the shortage of studies that explore the role 
of error correction in fostering language learning 
in e-mail tandem exchanges, we aimed to find out 
whether mutual error correction, as exercised by 
the participants in our exchange project, led to a 
development in their language competence. After 
carrying out an analysis of e-mail content, we 
found that students used three different types of 
corrective feedback which we have categorized 
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following James’ proposal (1998), as feedback, 
correction and remediation. He provides the 
following definitions for these three types of 
corrections: 


° Feedback: [informing learners] there is an 
error and leaving them to discover it and 
repair it by themselves. 

° Correction: providing treatment or informa- 
tion that leads to revision and correction. 

° Remediation: providing learners with 
information that allows them to revise or 
reject the wrong rule they were operating 
with, thereby inducing them to revise their 
mental representation of the rule and avoid 
recurrence of this type of fault. (pp. 236- 
7) 


According to these definitions, 19 students (10 
Spanish/9 Irish) used correction. All corrections 
were kept separate from the discursive content; 
most students included them at the end of their 
e-mails and two Spanish students sent them as an 
attachment. Students used a number of different 
models of correction. Sixteen (9 Spanish/7 Irish) 
used interlinear models (i.e., corrections appear 
between the lines) and 19 (10 Spanish/9 Irish) 
used intralinear models (i.e., corrections appear 
within the same line). There were eight students 
(4 Spanish/4 Irish) who rewrote whole messages 
and 11 students (6 Spanish/5 Irish) who rewrote 
whole paragraphs. With regards to remediation, 
we found 15 students (9 Spanish/6 Irish) who 
used this type of correction in their e-mails. Only 
one Spanish student used feedback in addition to 
correction and remediation and one Irish student 
did not correct at all. 

These findings seem to indicate that partner- 
ships were quite balanced in the way students 
supported each other with error correction. 
However, this was not the case when providing 
remediation since a higher number of Spanish 
students provided remediation together with 
more lengthy and detailed explanations. Thus, 


in the corpus of e-mails, we found 160 cases of 
remediation, of which 129 were offered by the 
Spanish students and only 31 by the Irish learners. 
A plausible explanation for this imbalance could 
be that the Spanish students, in addition to being 
specialist learners of English, had a good grasp 
of Spanish grammar. This may be due to the fact 
that Spanish language is a compulsory subject 
right up until university education begins whereas 
in Irish education, English language as a subject 
is only compulsory up until the age of sixteen. 
Furthermore, English as a subject in primary 
and secondary education in Ireland, is aimed at 
improving literacy (written and oral mostly) and 
places less emphasis on formal grammar learning. 
This could explain why the Spanish students, in 
general, seemed to be better equipped to offer 
remediation about more complex grammatical 
issues. The Irish students felt more comfortable 
with corrections and their remediation only in- 
volved very simple explanations. 

Examples of feedback, correction and remedia- 
tion, as they were offered by a Spanish student, 
are shown below. Extracts of messages have been 
left as they were written: 


. Feedback: 

En Irlandamuchos gente recibir vacaciones 
de trabaja entre () veintitrés de Diciembre 
y (tres de Enero. Elmavidad Eva, normal- 
mente, nosotros no tengamosa familia cena 
pero nosotros tendremos_a familia cena 
en el Dia de Navidad y es muy importante. 
() gente de Irlanda mucho beber alcohol 
durante el vacaciones de navidad pero en 
el Dia de Navidad el pub es _no permitir 
abierto. Asi todo el mundo pasar el dia con 
ellas familia. 

[In Ireland many people are on holiday from 
23" December to 3" January. On Christmas 
Eve we don’t usually have a family meal, 
we have it on Christmas day instead and it 
is very important. Irish people drink a lot 
at Christmas but the pubs are not open (are 
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not allowed to open) on Christmas day. That 
is why everybody spends the day with their 
families] 

* (means that you should add some- 
thing. 

* When I write in italics that means that 
you have not written the correct tense 
of the verb. 

* When the text is in_ bold and under- 
lined that means that the structure is 
not correct. 

Correction: 

En Irlanda mucha gente tiene vacaciones de 
trabajo entre el veintitrés de diciembre y el 
tres de enero. En Nochebuena, normalmente 
no tenemos (hacemos) una cena familiar 
pero si la tenemos el dia de navidad y es 
muy importante. La gente de Irlanda (los 
irlandeses) bebe mucho alcohol durante 
las vacaciones de navidad pero en el dia de 
Navidad los pubs no pueden estar abiertos. 
Asi, todo el mundo pasa el dia con sus fa- 
milias. 

Remediation: 

En Irlanda mucha gente > en espafiol, 
tienes que tener en cuenta el género 
(masculino 6 femenino) y el nimero (singular 
6 plural) [in Spanish you need to take into 
account the gender (masculine or feminine) 
and number (singular or plural)] 
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Masculino Femenino 
[masculine] [feminine] 
Singular | El /un/mucho La/una/mucha [the/ 
[singular] | [the/a/much] a/much] 
Plural Los/unos/muchos | Las/unas/ 
[plural] [the/a/many] muchas[the/a/ 
many] 


Ej: las vacaciones de Navidad > femenino 
plural 

Eg:[The Christmas holidays> feminine 
plural] 

El dia de navidad masculino singular 
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[The Christmas day> masculine singu- 
lar] 

Mucha gente > femenino singular 
[Many people> feminine singular] 

Para ello, tienes que mirar la palabra a la 
que acompafia. En el caso de mucha gente es 
algo distinto porque como en inglés, people 
se refiere a un grupo de personas, pero en 
espaiiol siempre va acompafiado de verbos 
y articulos en singular. 

[It is important to look at the word that 
goes with it. In the case of ‘many people’ 
it is slightly different, because in English 
‘people’ refers to a group of persons, whereas 
in Spanish itis always accompanied by verbs 
and articles in the singular] 


las fechas en espanol, siempre llevan articulo 
delante. 

Decimos: entre el veintitrés de diciembre y 
el tres de enero 

En vez de: entre veintitrés diciembre y tres 
de enero 

[There is always an article before dates in 
Spanish. We say from the 23rd of December 
to the 3rd of January instead of from 23rd 
December to 3rd January] 

() gente de Irlanda mucho beber alcohol 
> la gente bebe mucho alcohol en Irlanda. 
El error en esta oracion esta en la estructura 
de la frase. Recuerda la estructura de la 
oracion en espafiol. SUJETO+ VERBO+ 
COMPLEMENTOS (CD, CI, CC) 

[The error inthis sentence lies inits structure. 
Remember that Spanish sentence structure 
is as follows: Subject+verb+complements 
(direct object, indirect object, adverbials] 


Students also used different conventions de- 
pending on whether they provided correction or 
remediation. We found a considerable amount of 
typographical highlighting among students who 
used corrections, as can be seen in Table 1. 
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Table 1. Typographical highlighting found in the students’ e-mail corrections 


Typographical highlighting Spanish 


i 
= 
=F 
wn 
a 


Colors 


Brackets 


Capitals 


Inverted commas 


Colon 


Underlining 


Bold type 


Errors crossed out 


Equals sign (=) 


Dash 


COLOR IR IWINMS/O!}R]/O;D]Ww 


Numbering of errors 


Py |O;SOlO;R/O;RID/FR 


With regard to remediation, students used 
a smaller variety of typographical conventions 
(mostly bold type, brackets, capitals and inverted 
commas) to highlight errors and then provided 
an explanation in standard text (sometimes in- 
troduced by an arrow ~> or an equals sign =). 
Seven students (6 Spanish /1 Irish) also provided 
multiple examples and most instances of meta-talk 
appeared in connection with remediation. 


“Hace mucho tiempo que te he escribado.” First 
of all, the participle of escribir is irregular “es- 
crito.” Furthermore, I do not think this tense is 
correct. I would have said “Hace mucho tiempo 
que no te escribo” or at least just added no “hace 
mucho tiempo que no te he escrito.” 

“No hago veo” no es igual que no veo. En inglés 
en este caso, el “do” que has traducido no lo 
deberias haber traducido porque funciona como 
auxiliar. Si funcionase como verbo, si tendrias 
que traducirlo. 

[“I do not make see” is not the same as “I do not 
see.” In English, the verb ‘to do’ that you have 
translated into Spanish should not have been trans- 
lated because it functions as an auxiliary. When it 
works as a verb you do need to translate it] 


Ej: Ido my homework hago mis deberes: fun- 
ciona como verbo, va solo [here ‘to do’ functions 
as a verb, it appears on its own] 

I do not see my family> no veo a mi familia: 
funciona como auxiliar porque acompafia a otro 
verbo [here ‘to do’ functions as an auxiliary be- 
cause it accompanies another verb] 


When providing remediation, the students 
tended to offer general grammatical rules in order 
to facilitate understanding of those errors they 
considered particularly difficult or that tended to 
appear time and again. Most of these cases were 
generalizations across the language system (we 
found 145 instances, of which 115 were offered by 
the Spanish students and 30 by the Irish students) 
and a much smaller number were generalizations 
across interlanguage (we found 15 instances, of 
which 14 were offered by the Spanish students 
and 1 by an Irish student): 


Generalizations across the language system: 

You wrote, “what are you doing when you going out 
with your friends at weekends?” and you should 
say, “What do you do when you go out with your 
friends at the weekend? Again whenyou said, “We 
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usually going out...” you need to use the present 
form of the verb “we usually go out.” You use 
the endings (or terminations?) of verbs wrong. 
Such as, you say “cuando yo escribia” instead of 
“cuando yo escribi.” Why? We speak in the past 
use “our past simple” (el pasado simple) because 
it is an action that you finish. Our past is as your 
past simple. You put “escribia”, “escribia” is 
another kind of past. We use it when we speak of 
habit in the past, as your “used to.” 


In general most of the observations offered 
by the students were accurate and they identified 
their partners’ errors correctly. However, students 
sometimes provided inaccurate explanations, such 
as the one in this example: 


When you say “I don’t spend many 
time...” you should say “much” instead of 
many. Much is used for a specific case, 
as in “I don’t spend much time when I 
write to you” whereas many is for gen- 
eral cases, “many times when I write, I 
don’t spend much time.” Does it make sense? I 
hope I’m explaining it well! 


This student fails to explain the correct use of 
‘much’ and ‘many’ byreferring to specific/general 
cases instead of the difference between countable 
and uncountable nouns. 

In regard to generalizations across interlan- 
guage, these were used less frequently and we only 
found 15 instances in our corpus of e-mails (as 
opposed to 145 instances of generalizations across 
the language system). These findings differ from 
those of Little et al. (1999), who suggest that “gen- 
eralizations across the partner’s interlanguage 
are much more frequent than generalizations 
across the language system ...” (p.46). Despite 
this discrepancy, we also found in our study some 
attempts on the part of students to try to identify 
their partner’s major linguistic deficits: 
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Generalization across interlanguage: 


Como siempre tu y los géneros...© No te preo- 
cupes, se que no es facil ya que no coinciden en 
inglés y en espanol y que hay palabras en inglés 
que incluso no tienen distincidn de género. 

[As usual, you and your genders...© Don’t worry, 
I know it’s not easy since they don’ coincide in 
English and Spanish and there are some words in 
English that have no gender distinction] 

You made quite a few spelling mistakes this time, 
but I think it’s keying errors, thinking quicker than 
you’re typing hey. 

You seem to have some problems with your verbs: 
persons, tenses, aspects especially with the sub- 
junctive but I’m going to send you some rules that 
you can learn and I will explain them in English 
because they are complicated. 


Once we analyzed the types of correction and 
conventions used by the students in their e-mails, 
we moved on to analyzing whether there were 
any instances of recycling/re-use of the correc- 
tions offered by their partners in later e-mails. 
This aspect was particularly relevant, since the 
presence of error recycling could be considered 
an indicator of language learning actually tak- 
ing place. In addition, we wanted to find out 
if our study had anything new to contribute to 
current research, given that recycling of errors 
had been a weak point in previous studies. Our 
data analysis produced the following results: 13 
students (6 Spanish/7 Irish) took into account 
some of their partners’ corrections/remediation 
and wrote the corrected form in later e-mails. We 
found 20 instances of recycling errors, of which 
3 (15 percent) occurred after correction and 17 
(85 percent) after remediation. These findings are 
presented in Table 2. 

These findings are quite revealing, since 
remediation increased the percentage of errors 
recycled by 70 percent. Thus, 85 percent of er- 
ror recycling took place after remediation was 
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Table 2. Results for recycling of corrected errors in e-mails 


Corrections Instances Spanish students Irish Students 
Spelling 2 (10 percent) 1 (2 instances) 

Word order (N-Adj) 1 (5 percent) 1 

Remediation 

Verb-subject inversion 1 (5 percent) 

Ser-estar 3 (15 percent) 3 
Gender (masc-fem) 2 (10 percent) 2 
Use of verbal tenses 4 (20 percent) 1 (3 instances) 1 
Coordination Poss-N 1 (5 percent) 1 
Coordination N-Adj 1 (5 percent) il 
Contractions 2 (10 percent) 1 (2 instances) 

Colloquial expressions 3 (15 percent) 1 (2 instances) 1 


provided by partners, whilst 15 percent occurred 
after correction. Other data showed that in the two 
exchanges in which the Irish partners provided no 
remediation whatsoever, the Spanish partners did 
not recycle any errors. Similarly, in the exchange 
in which corrections alone were offered by both 
partners, no samples of re-used corrections were 
found. Finally, inthe exchange in which one of the 
partners made no corrections at all (one Irish), the 
Spanish partner was unable to recycle corrections. 
There are two exceptions to these findings, how- 
ever, since two Irish students did not recycle any 
corrections in spite of the fact that their Spanish 
partners offered ostensive remediation. 

As regards the types of errors that were cor- 
rected, we discovered that the students focused 
mainly on lexical terms for correction, whilst 
syntactic structures were usually treated by re- 
mediation. Thus, those errors relating to spelling 
and noun-adjective position (in Spanish) were 
handled through correction, whereas subject-verb 
inversion (in questions), differences between ‘ser’ 
and ‘estar’ in Spanish, coordination in gender 
and number between nouns and adjectives and 
possessives and nouns, use of different verbal 
tenses, colloquial expressions and the use of 


contractions in English (I’ve, don’t) were treated 
through remediation. 


CONCLUSION 


The findings of this study suggest that the use of 
corrective feedback can foster language develop- 
ment in e-mail tandem learning projects. However, 
they also indicate that remediation, as opposed 
to correction and feedback, seems to be more ef- 
fective in fostering linguistic development since 
this encourages recycling of errors. Therefore, it 
should be a priority for future tandem projects to 
ensure that teachers explain and provide examples 
regarding the differences between feedback, 
correction, and remediation. Thus, induction 
sessions should include this aspect in order to 
help students reflect on the language learning 
process and improve their correction skills. It 
should also be explained that although correc- 
tions may be used for misspellings and minor 
lexical problems, more complex syntactical errors 
are more efficiently treated via remediation. In 
order to facilitate the provision of remediation, 
students should be encouraged to use textbooks, 
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reference books and suitable language web sites 
or to pose specific questions to their tutor when 
needed. Finally, the importance of mutual support 
through remediation should be emphasized since 
this seems to be an essential contributing factor 
in fostering language development via e-mail 
tandem exchanges. 
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KEY TERMS 


Autonomy in Language Learning: A capac- 
ity to take charge of, or take responsibility for 
one’s own learning. Therefore, autonomy involves 
abilities and attitudes that people possess and can 
develop to various degrees. 
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Asynchronous Communication: Learners 
do not communicate in real time. Rather, they 
send messages to each other and collect messages 
when it is convenient to them. E-mail, letter writ- 
ing, and voicemail are all forms of asynchronous 
communication. 


Collaborative Learning: A way of learning 
in which students at various performance levels 
work together in small groups toward a common 
goal. Tandem learning is a type of collaborative 
learning. 


Negative (Corrective) Feedback: Tells the 
learner what linguistic features in the input are 
not possible in the target language. 


Positive Feedback: Tells the learner what 
linguistic features in the input are possible in the 
target language 


Reciprocity: Refers to the partners’ mutual 
support in the learning process; both partners 
should contribute equally to their work together 
and benefit to the same extent. 


Synchronous Communication: Commu- 
nication occurs when learners communicate 
in real time, either in a face-to-face situation, 
on the telephone or using the Internet. MOOs, 
IRC (Internet relay chat), chatting, audio and 
videoconferencing are all forms of synchronous 
communication. 


Tandem Learning: A mode of learning in 
which you work together with a partner from an- 
other country in order to learn each other’s native 
language. Itis based onthe principles of autonomy 
and reciprocity and it can take place either face- 
to-face or at a distance (either in synchronous or 
asynchronous forms of communication). 
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APPENDIX | 


General Guidelines for the First 
Semester 


Tandem Learning by E-Mail 
Spanish-English 


Departments of Applied and Modern Lan- 
guages 

Dr. Marga Vinagre 

Ms. Maria Lera 

Adapted from Appel (1999) 


What Is It? 


This project consists of pairing native speakers 
of Spanish with native speakers of English so 
that they can help each other with their foreign 
language learning. It follows the conventions of 
the International E-mail Tandem Network funded 
by the Commission of the European Union since 
1994. You can find more information about the 
International E-mail Tandem Network at http:// 
www.slf.ruhr-uni-bochum.de. 


Why Learn a Language via E-Mail? 


Several characteristics/aspects of e-mail make 
this medium ideal for language learning: 


1. Messages are sent and received in a matter 
of minutes. Communication is fast and up 
to date. 

2. You have first hand access to a person who 
speaks the language you are studying. 

3. Certain commands such as reply or attach 
facilitate the exchange of corrections and 
other material you would like to share with 
your partner. 


Which Language Should You Use? 


It is important that both partners write in both 
English and Spanish. This will give you both a 
chance to write as well as read in the language 
you are learning. Reading your partner’s mes- 
sages in English will give you a model to follow 
and a feeling of how English is used by native 
speakers. Writing will give you a chance to put 
into practice what you know and discover areas 
in which you may have difficulties. For the same 
reasons your partner needs to write messages in 
Spanish and read your messages in Spanish too. 
It is therefore important that you make sure you 
use both languages in your e-mail exchange by 
taking. 


What Do I Need for Active Learning? 


A Dictionary: Have a dictionary with you every 
time you write an e-mail in English. This 
way you will enhance your knowledge of 
vocabulary by using new words and expres- 
sions that are different from the ones you 
already know. 

A Diary: Write a diary about how your tandem 
exchange develops is essential, since it will 
help you evaluate how much you are learn- 
ing and will allow you to make decisions 
regarding your own learning. 

In your diary, you can write about ALL 

aspects concerning the exchange, but three 

aspects should be considered regularly and 
described in detail: 

Vocabulary: Make note of the new words 
you learn, either from your partner or 
from the use of the dictionary. 

Errors: Make note of the errors your partner 
corrects for you and write down a few 
sentences with the corrected version so 
that it is easier for you to avoid them 
in the future. 
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Culture: What aspects related to your 
partner’s culture and way of life have 
you learned about? Compare them 
with your own and give your opinion 
briefly. 

The diary must be handed in at the end of 

the semester since it will be used to assess 

your language learning progress 


What Should You Write About? 


First, write an introductory message telling your 
partner about yourself and your interests. You 
may have common interests you want to discuss 
or you may want to ask your partner about several 
aspects of Ireland and Irish culture you would like 
to know more about. 

The following list contains activities and top- 
ics which you should note are only suggestions 
for what you might want to talk about with your 
e-mail partner. 


Week starting October 17: Getting to know 
each other (two e-mails): Where does your 
partner live? In what type of house? With 
whom? What would be a typical day in your 
partner’s life? What does your partner usu- 
ally do at weekends? 

Weeks starting October 24 and November 1: 
Discuss stereotypical beliefs about both 
countries: Spanish and Irish stereotypes 
(four e-mails). TWO e-mails to find out 
what the real situation is in both countries. 
What do you think they are like? (customs, 
way of life, traditions, etc.) In his or her 
opinion, what are Spanish people like? What 
does your partner think about Spanish way 
of life, Spanish customs and traditions, dress 
sense and food for example? What aspects do 
you have in common with your partner and 
in what do you differ, and to what extent is 
all this because of your different nationalities 
and cultures? TWO e-mails to talk about 
one or more topics you decide to discuss 
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together (negotiation) DON’T FORGET TO 
TALK ABOUT FESTIVITIES! Halloween, 
El Dia de Todos los Santos. 

Weeks starting November 7 and November 
14": (four e-mails). TWO e-mails at least 
to help your partner with colloquial expres- 
sions in Spanish; he/she will do the same to 
help you with English slang. TWO e-mails 
to talk about one or more topics you decide 
to discuss together (negotiation). 

Week starting November 21: (two e-mails). 
ONE e-mail at least: What do young people 
in Spain do when they go out? Compare it 
with what they do in Ireland. ONE e-mail 
to talk about one or more topics you decide 
to discuss together (negotiation) 

Week starting November 28: (two e-mails). 
ONE e-mails at least to talk about music, 
literature or art. Discuss your own interests 
and ask about your partner’s. ONE e-mail 
to talk about one or more topics you decide 
to discuss together (negotiation) 

Weeks starting December 5 and December 12: 

(four e-mails). TWO e-mails to talk about 
cinema. Vanilla Sky vs Abre Los Ojos (class 
activities) Forum of discussion. TWO e- 
mails to talk about one or more topics you 
decide to discuss together (negotiation). 
DON’T FORGET TO TALK ABOUT 
FESTIVITIES! El Dia de la Constitucién 
and La Inmaculada. Try to find out what 
kind of festivities they have over there and 
the way they celebrate them. 
TASK: Discuss and prepare together the 
topic of your end of semester presentation. 
You will have to talk to the rest of class 
about one aspect of your choice related to 
Irish/British culture. 

Week starting December 19: (two e- mails). 
ONE e-mail to talk about Christmas in 
both countries. ONE e-mail to finish the 
exchange and decide whether you would like 
to continue writing to each other ;-). 
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NOTE: Be polite and respectful when you 
express your opinion but do give your point 
of view and disagree when necessary. Do 
justify your ideas/remarks to make the ex- 
change more interactive and productive. Be 
open to receive some positive criticism from 
your partner too! Your attitude towards the 
exchange should always be active; you are 
learning by helping someone else to learn 
at the same time! 


Please remember to send a copy of ALL e-mails 
to your teacher: mvinagre@nebrija.es. 


How to Correct Your Partner’s Writing 


Think about what you would like your partner to 
correct in your writing and do the same. 

Do not try to correct everything. Pick the 
most important mistakes (make it no more than 
10), the ones that prevent understanding or sound 
awkward (too foreign) to you. 

Negotiate the way you are going to correct each 
other (using CAPITAL letters, colors, directly on 
the e-mails by clicking on reply button, etc). It is 
important that you come to an agreement with 
your partner so that you always correct each other 
in a manner that works for both of you. 

Remember that in order for both of you to 
benefit from the exchange you should both take 
the task of correction seriously. 

Correcting your partner’s mistakes will help 
develop your ability to assess your own writ- 
ing. 


Pay careful attention to your partner’s mis- 
takes and way of formulating things in Spanish 
so you can learn even more about the way English 
language works. 

RECYCLE ERRORS! Make sure you in- 
clude some of the corrected errors in the fol- 
lowing messages you write. If you include the 
errors your partner has corrected in the following 
e-mails you send to him or her, it is more likely 
that you will not make them again in the future. 


This aspect is crucial for the assessment of your 
own learning progress. 


Taking the E-Mail Exchange One Step 
Further 


Here are some suggestions for further work re- 
lated your regular English classes once you have 
established contact: 


1. Write essays on topics suggested previ- 
ously. 

2. Discuss the topic of your oral presentation 
with your partner, so that you include the 
information you have found out. 

3. Keep track of your own errors to ensure 
continued improvement. 

4. Analyze your partner’s messages in English. 
Review old messages. 
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Chapter XX 
Emerging Feedback in 
Two Asynchronous 
ESL Writing Forums 


Stella K. Hadjistassou 
Arizona State University, USA 


ABSTRACT 


This study reports ona culturally-transforming group activity using asynchronously-mediated forums on 
the “discussion board” of Blackboard Academic Suite. Seventeen English as a second language (ESL) 
learners enrolled in a university-level writing course used the discussion board to engage in asynchro- 
nous collaborative forums where they presented and shared their paper topics and personal experiences, 
offered suggestions to their peers, and raised critical questions that were meant to help their peers think 
more critically about the assigned writing genres and their selected paper topic. The data suggest that 
participation in asynchronous computer-mediated communication (ACMC) forums can help students 
develop a deeper understanding of the writing assignments and encourage them to implement describ- 
ing and narrating strategies to provide feedback to their peers. Students can also gradually produce 
feedback that is more complex, constructive, and challenging to their peers and begin improving their 
writing skills by developing more formal, sophisticated and complex language. 


INTRODUCTION construed learning that fosters collaborative 

network communities often anchored in goal- 
Computer-mediated communications (CMC) oriented activities, situated learning, reflective 
have expanded the pedagogical and technologi- discourse, and exchange of ideas and values. More 
cal landscape in the ESL classroom by providing precisely, ACMC, within the cultural-historical 
multidimensional and multidirectional socially- activity approach, have evolved as an effective 
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interactive medium embedded in collaborative 
learning and delayed exchanges that can trans- 
form the learning experience, the learner, and the 
medium. Cummins and Sayers (1990, 1995) note 
that CMCare carried out in online collaboratively- 
built, intercultural forums which aims to expand 
learning on the individual, but also the macro or 
socially-situated, plane. Warschauer (2005) even 
suggests that “technology is just atool, but, like all 
tools, it mediates and transforms human activity” 
(p.48). In the ESL or foreign language classroom, 
learners can transform, both at the micro or in- 
dividual and macro or broader community level, 
written discourse to create collaborative online 
environments that promote more interactive and 
motivating student-student exchanges than face- 
to-face (FTF) encounters (Kern, 1995). 

Within these cultural-historical realisms of 
language learning, several empirical studies 
have been conducted on ACMC and feedback 
exchanges, which rely mainly on pedagogically- 
oriented listservs, e-mails, and Web-designed 
bulletin boards, to investigate the development 
of writing skills in L2 or foreign language. It is 
important to note that Abrams (2003), Beauvois 
(1992), Chun (1994), Kelm (1992), Kern (1995), 
Warschauer (1996), and Zeiss and Isabelli-Gar- 
cia (2005) provided important methodological 
constructs for collaborative learning using CMC. 
Through their studies, these scholars have in- 
dicated that the interactive nature of CMC can 
enhance structural participation in collaborative 
activities and offer (a) forums for more elabo- 
rate use of interactive written discourse among 
students than FTF conversations, (b) an online 
interactive space where students can rely ex- 
tensively on the written constructs of the target 
language, (c) hence, an improvement in students’ 
reading, writing, and intellectual skills and () 
more equality, improved balance than FTF inter- 
actions, (e) more thorough analysis and reflective 
feedback than FTF forums, (f) a higher level of 
motivation in nonnative speakers relying on the 
asynchronous written exchanges to interact with 


native speakers or to study in that country than 
students in FTF classroom settings, (g) less pres- 
sure to engage in an online group conversation 
than in a FTF meeting. 

Following the theoretical frameworks on 
interaction, these studies on CMC stirred the 
mechanisms of collaborative discourse in ACMC 
with Sotillo (2000) indicating that ACMC can be 
turned into practical and useful tools for learning 
in ESL extending beyond the FTF oral exchanges. 
Sotillo (2000) also postulates that “In general, 
student output in the asynchronous discussions 
was lengthy and more syntactically complex 
than that available in synchronous discussions” 
(p.104). Abrams (2003) also suggests that students 
in the ACMC group in her study “used more 
subordinate, relative, and infinitive clauses during 
their computer-mediated communications” than 
during oral discussions (p.163). Abrams (2003), 
however, is cautious to note that more complex 
syntactical features may not be reflected in oral 
discourse and output production might be higher 
during real-time and oral discussions. Zeiss and 
Isabelli-Garcia (2005) also assert that online 
cross-cultural communications between native 
speakers and nonnative speakers can play an 
importantrole in promoting cross-cultural aware- 
ness and in stirring students’ interest to study in 
a foreign country. 

Van Handle and Corl (1998), who examined 
e-mail exchanges among students enrolled intwo 
intermediate German classes, note that e-mail 
writing “provides an excellent first step to help 
students prepare for the face-to-face classroom 
discussion as well as the more carefully conceived 
and polished written compositions instructors 
ultimately expect from their students” (p.130). 
Lamy and Goodfellow (1999) explored feedback 
exchanges among intermediate-level students in 
online French classes and their tutors to conclude 
that tutors who maintain a more social interactive 
approachalso foster student-student communica- 
tions, while tutors who rely extensively on the 
syllabus during their online support improve 
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students’ knowledge on the subject. Thorne (2004), 
citing action research by Jimenez and Zapata, 
contends that, in the case of Spanish L2 learners, 
e-mail feedback provided by advanced learners to 
low-intermediate learners can offer an effective 
medium for peer revision at the college level. 

These studies placed the ACMC among ESL 
or EFL students in technologically-and com- 
municatively-oriented online forums that reach 
beyondthe FTF context. However, as Warschauer 
(1997) notes, the inquiry into the collaborative 
constructs of CMC and writing is still limited 
and often hindered not simply by methodological 
and practical constraints but also by institution- 
ally- and culturally-sanctioned teaching practices. 
Further, many recent studies investigating ACMC 
and writing relied on interactions among ESL or 
EFL student exchanges at a global level, but little 
attention has been given to the collaborative con- 
structs at the local level, that is, among students 
enrolled in the same class. Further, studies have 
not examined closely how ACMC can be turned 
into an effective interactive medium to build new 
or advanced writing skills in L2. 

To examine the role of ACMC as an interactive 
online tool that plays a central role in transform- 
ing peer feedback at the local level and within the 
cultural-historical activity tradition, this study 
addresses the following questions: (1) How can 
participation in ACMC offered on the discussion 
board of the Blackboard Academic Suite ver- 
sion 7.0 help ESL students create a collaborative 
learning environment where they can provide and 
receive feedback on their paper topics and later 
on implement it in their rough drafts? (2) How 
effective is this process of offering feedback in 
reformulating more complex and challenging 
suggestions for their peers and, at the same time, 
helping students improve their personal writing 
skills, not simply in their papers but also while 
giving feedback? To address these questions and 
examine the peer review process on ACMC as 
a collaborative activity, it is essential to place it 
within a cultural-historical activity framework 
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and, more precisely, within Engestrém’s (1987, 
1993, 1999) theory-praxis learning realisms. The 
proposed approach offers a polysided and complex 
framework to examine L2 development and CMC 
at the interrelated individual and group planes. 


CULTURAL-HISTORICAL 
CONCEPTUALIZATIONS OF 
COLLABORATIVE ACTIVITY 


The theoretical-methodological exegeses offered 
by cultural-historical activity theory have pro- 
vided a scholarly forum to examine second and 
foreign language learning as part of a historical 
and individual framework. Engestrém (1987, 1993, 
1999) and Cole and Engestrém (1993) provide 
the theoretical-practical constructs of human 
learning which should be examined based on 
the material socio-cognitive and historical or 
cultural levels where it is scaffolded, negotiated, 
and acquired by each learner. Expanding on 
Vygotsky’s (1978,1986) and Leont’ev’s (1978, 
1981) approaches, Engestrém (1987, 1993, 1999) 
theorized that the cultural-historical tenets of 
individual and group or social learning should 
be first linked and then investigated through a 
theoretical-practical forum. Engestrém postulates 
that subjective or individual knowledge is initiated 
at a broader collective or group context. Hence, 
he meticulously draws the connective realisms 
between the essential components contributing to 
expanding one’s knowledge: “the object, subject, 
mediating artifacts (signs and tools), rules, com- 
munity, and the division of labor” (Engestrém, 
1999, p. 9). 

Engestr6m extends Leont’ev’s (1978) hierar- 
chically-oriented activity, which includes three 
constructs: (1) activity which is initiated by or 
formed based on biologically-, culturally-, and 
socially-driven needs; (2) an action which is 
instigated by goal-oriented socially or individual 
meaningful behavior; (3) operational conditions 
through which task actions are accomplished 
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within culturally-mediated lines. Drawing on 
Vygotsky, Leont’ev places a learner’s cognitive 
participation within the culturally-mediated or 
extended interactional contexts which are initi- 
ated at the historical and individual levels. Like 
Vygotsky, Leont’ev (1981) was inspired by Marx’s 
philosophical ideologies, as discussed in Theses 
on Feuerbach, which hypothesizes that human 
activity is an intense tool-mediated construct 
where the “tool mediates activity and thus con- 
nects humans not only with the world of objects 
but also with other people” (p. 56). 

Leont’ev even distinguishes between the ob- 
jective individual action and its socially-mediated 
value and suggests the theoretical integration of the 
division of labor within this learning framework 
(Engestrém & Miettinen 1999). Leont’ev draws 
on Vygotsky’s trilaterally-inspired model, where, 
in a socially-determined learning environment, 
the subject uses successfully the collectively- 
construed tools, such as language, to shape the 
object of activity and to master additional lin- 
guistic competency within the zone of proximal 
development (ZPD). That is, capitalizing, not 
on one’s currently accomplished or existing L2 
competency, but on enhancing one’s future L2 
constructs that are developmentally feasible, that 
is, acquiring new writing skills in L2. Similar 
to Vygotsky, Leont’ev expands on the Marxist- 
inspired theory of participation in labor-intense 
activities and on Engels’ concept of the production 
of tools to frame human activity in collective- 
practical motifs that are (re)formed by individual 
and sociohistorical constructs. 

For Leont’ev, activity is at the core of each 
transforming individual and group action which 
is carried out in specific historical practices. As 
Davydov (1999) notes, “Activity is a specific form 
of the societal existence of humans consisting 
of purposeful changing of natural and social 
reality...Any activity carried out by a subject 
includes goals, means, the process of molding the 
object, and the results. In fulfilling the activity, 
the subjects also change and develop themselves” 


(p.39). Leont’ev asserts that activity needs to be 
perceived through a hierarchically-driven model, 
where each activity derives from motivated and 
goal-determined actions, which form the driv- 
ing force for sculpting learning. These three 
components of an activity system are pivotal for 
acknowledging inasingle theoretical approach the 
main tenets of analysis, but they do not explicitly 
draw a direct correlation between the individual 
and cultural-historical bases of knowledge (Cole 
& Engestrém, 1993; Engestrém, 1987, 1993, 1999; 
Engestr6m & Miettinen, 1999). 

Stetsenko (2005) hypothesizes that, to over- 
come such theoretical and structural limitations, 
cultural-historical activity theory needs “to 
include the notion that material production, in- 
tersubjective exchanges, and human subjectivity 
form aunified three-fold dialectical system” (p.70). 
To achieve this integration of collectively- and 
individually-endowed mechanisms, itis essential 
to treat activity as asingle framework that applies 
both to the theoretical and practical trajectories 
of learning. Engestr6ém (1993) assert that, the 
inter- and intra-subjective dimensions of learning 
can be interlinked through an extended complex 
activity system. Hence, Engestr6m proposes an 
activity system which establishes this inter- and 
intra-subjective connection. At the same time, 
Engestrom indicates that it is crucial to examine 
how the objectified construct or goal of each 
activity is determined by how successfully a 
learner undertakes different learning challenges 
to build new knowledge and to change the learn- 
ing processes or conditions. 

Engestrém’s newly reconfigured model 
(re)produces human activity by constructing it on 
a much more complex, interactive, and creative 
context. As Engestrém notes, the subject may 
refer to a single learner or to a broader local or 
global community of learners, whose close or 
extended collaboration can be instrumental in 
(re)formulating the object or learning within 
historical and collective structures. The object is 
the nucleus of this complex activity system since 
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it reflects on one’s attempt to bring on a change 
or to enhance one’s knowledge by incorporat- 
ing the societal and cultural tools or artifacts of 
learning and gradually yield a certain outcome. 
One’s actions, however, are not abstract from or 
alien to social rules, norms, or the community. 
To the contrary, each learner is part of a broader 
local or extended local or global community or 
social strata, so he/she has to abide by and act 
based on certain institutional and cultural rules. 
Power structures and assignment of tasks or 
responsibilities set the rules and conventions, 
under which all members of this community col- 
laborate. Engestrém captures these socially- and 
hierarchically- organized structures by drawing 
attention to the division of labor. 

Within this theoretical-methodological out- 
line, Engestrém has introduced into the already 
polydimensional and multifaceted web of human 
activity a practical lens to examine language 
learning in its historical and subjective context. 
Such theoretical-methodological exegeses have 
also identified new paths to language learn- 
ing (Wells, 1999, 2001) and second language 
acquisition (Lantolf & Thorne, 2006) and the 
implementation of technological means, such as 
ACMC communications (Thorne, 2004). This 
model captures the acquisition of new knowledge 
in L2 and provides the structural and interactive 
tenets that lay the foundations for extended learn- 
ing in interactive and collaborative institutional 
settings. As Wells (2002) indicates, by applying 
the notion of “knowledge building,” learning is 
turned into a goal-directed activity where: 


1. ‘The aim is to create a common, or shared, 
understanding to which all contribute, 
whether overtly or through responding inter- 
nally to the contributions of others (Bakhtin 
1986)...[so that knowledge building]. 

2. Occurs inrelation to an object that the com- 
munity, or some members of it, are trying 
to improve (p.8-9). 
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In the L2 classroom in particular, this concep- 
tualization of co-forming knowledge, as perceived 
through the lens of cultural-historical activity 
theory, offers several instrumental and effective 
constructs for learning, such as: 


° Learning activities in individual and col- 
laborative context mediated by institution- 
ally- and socially-organized trajectories that 
lead to L2 learning 

. Engagement in intellectually challenging 
activities mediated by cultural ortechnologi- 
cal tools such as asynchronously-mediated 
computer exchanges that enhance L2 learn- 
ing (Nardi & O’Day, 1999; Thorne, 2004) 

° Individual learning in the target language 
as perceived through a theoretical-practical 
interpretation that places one’s learning ina 
broader local or collective learning network 
or community 

¢ The objectified activity (e.g., essay writing 
and peer feedback) forms the individual, 
situational, and extended collective goal 
which students attempt to master through 
collaborative and engaging tasks 

° Collaborative engagement in demanding 
and productive activities that also provide 
assistance to other peers, especially during 
ACMC 

. Participation in innovative learning tech- 
niques that rely on the trajectories of the 
each learner’s ZPD to foster learning that is 
deeply rooted in the written discourse and 
in L2 cultural experiences 

. Richinstitutionalized and cultural discourse 
that is nestedin ACMC inan effort to expose 
students to each other’s position on an issue 
and to promote participation in an L2 peer 
review activity 


This motif of an evolving historically and 
socially linked activity model has provided the 
theoretical and practical strands in second lan- 
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guage acquisition and the use of the asynchronous 
medium, which has the capacity to help students 
develop a more concrete understanding of the 
writing assignment through individual and group 
learning tasks. Within these theoretical concep- 
tualizations, then, asynchronous discussions can 
facilitate interactive exchanges, enable students 
to share their opinions, ideas, experiences, and 
personal values and finally allow them jointly 
to evaluate the topic and gradually arrive at a 
more contextual and complete understanding of 
the topic and to improve their writing skills in 
two specific genres of writing, describing and 
profiling. 


THE STUDY 
The data for this study formed part of a larger 
study on ACMC and FTF collaborative feedback 


conducted during the course of an academic 
semester at Arizona State University. The cur- 


Table 1. Participants 


rent study focuses on the implementation of 
the asynchronously-built discussion board of 
Blackboard Academic Suite version 7.0 in an 
ESL writing course, English 107. All under- 
graduate ESL students attending Arizona State 
University are required to enroll in English 107 
before advancing to the next level, English 108. 
English 107 introduces students to the modes of 
social and personal genres of writing, such as 
personal narratives, while English 108 focuses 
on argumentative discourse. Placement in ENG 
107 adheres to arigid university policy according 
to which each student’s final score on the stan- 
dardized TOEFL needs to be above 540 on the 
paper-based, or above 207 on the computer-based 
test, in order to enroll in the course. 

As indicated in Table 1, from this particular 
English 107 section in which the data were col- 
lected, 17 ESL students, 12 males and five females, 
with ages ranging from 17 to 32 from a widely 
diverse cultural background, ranging from Af- 
rica to Italy, from Korea to Taiwan, from Spain 


P7Jun-Ho SM Korea 


M 
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to India, participated in this study. All students 
were given pseudonyms to protect their identities. 
Fifteen of these students had recently moved to the 
United States to pursue undergraduate degrees. 
Only two of the students, “Zhen” and “Suri,” 
had lived in the United States for approximately 
four years prior to taking this writing course. 
None of the students had previously enrolled 
in a university-level ESL writing course. All 
students had either received some training in 
Blackboard Academic Suite 7.0 from previous 
courses or participated in a brief formal training 
session offered by on-campus computer-support 
services. Additional short tutorials and technical 
support on this pedagogical forum were offered 
by computer-support services online or at several 
on-campus computer labs. 


ASYNCHRONOUS THREADS ON 
THE “BLACKBOARD SYSTEM” 


Blackboard System or Blackboard, as it is often 
referred to, is based on release 7.0 of Blackboard 
Academic Suite, an online forum which offers a 
pedagogically-constructive learning environment 


that fosters a community-centered approach. 
Students enrolled in this English 107 class had 
gained access to the Blackboard System through 
a user-friendly, technologically-enhanced gate- 
way, “MyASU portal.” By simply logging onto 
“MyASU portal,” students hit instantly “my- 
courses,” then selected “English 107” that would 
direct them to the “Blackboard” of the course. By 
selecting the “discussion board,” students were 
transferred to the asynchronous forum, “Tentative 
Topic for Paper # 2” and, later on in the semester, 
to “Tentative Topic for Paper # 3,’ where they 
were given certain guidelines on how to post 
their paper topics for each paper. By hitting on the 
“Add New Thread” button, students could discuss 
their paper topics, view their classmates’ paper 
topics, and post their feedback, which appeared 
just below each student’s paper topic. The title of 
each student’s posting appeared to the left of the 
screen, with his/her name in the center, and date 
and time of posting to the right of the screen. All 
unread messages were highlighted in red, with 
the indication “new” appearing to the right of the 
screen. Students could simply scroll down to select 
any unread messages they desired to read. Figure 
1 illustrates the format of the Blackboard. 


Figure 1. The Blackboard System used for asynchronous postings 
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PROCEDURES 


Students in this particular English 107 section 
met in a conventional FTF classroom three times 
a week for a 50-minute time period and several 
times throughout the semester posted on differ- 
ent asynchronous discussion forums using the 
discussion board. The data for this study were 
collected on two different asynchronous postings 
on the discussion board, with a time interval of 
approximately one month (October and Novem- 
ber). Students were first introduced to the two 
writing genres, “remembering people” and “cre- 
ating a profile” and their rhetorical modes. Then 
they were given ample opportunities to examine 
instances in which these strategies were applied 
in different contexts. Students were also invited 
to apply these strategies to freewrite, invent, and 
engage in various group discussions designed to 
apply in actual context these writing strategies, 
such as description, the use of anecdotes or the 
five senses, narrative action, classification strate- 
gies, and so on. 

After students became acquainted with these 
strategies, they were introduced to the writing 
assignment, and a new asynchronous forum on 
the discussion board was developed to post, share, 
and provide each other feedback on their paper 
topics. Specific directions and guidelines were 
provided in each case. For example, to receive 
credit for their postings, students were required to 
introduce, in about a paragraph, their paper topics. 
Further, before or after discussing their topics, 
students could also read their classmates’ topics, 
the suggestive feedback, and select at least one of 
their classmates to provide him/her with valuable 
feedback on how to improve his/her paper topic. 
Adhering to Aljaafreh and Lantolf’s (1994) and 
Ohta’s (2000) studies on microgenetic develop- 
ment, student feedback needed to be challenging 
and constructive to help them examine their topic 
from a different ideological perspective or to help 


them devise an effective plan for drafting their 
papers. Students could also benefit by receiving 
feedback from their classmates andimplementing 
it to compose their rough drafts. 

All threads on the asynchronous forum could 
be posted at students’ own convenience (usually 
within a week after the discussion board was set) 
and were automatically saved on the discussion 
board for further analysis. As Warschauer (1997) 
asserts, such ACMC can form animportant tool for 
turning delayed conversations into a collaborative 
student-led forum to promote critical reflections. 
To ensure that students developed a deep under- 
standing of the assignment and benefited from 
their peers’ feedback, all postings needed to be 
completed before drafting each paper. Students 
were required to implement only those suggestions 
that would guide and/or assist them in compos- 
ing their drafts. To determine the total number 
of suggestions that were actually implemented, 
all suggestions were thoroughly analyzed and 
numbered, and, then, an in-depth analysis of the 
students’ rough drafts was conducted. A similar 
approach was applied ina study on Spanish learn- 
ers discussed by Thorne (2004), but the focus 
of that study was on suggestions pertaining to 
grammatical features. 

In this study, the emphasis was placed on sug- 
gestions for writing strategies, such as descrip- 
tive details, narrative action, use of dialogue and 
anecdotes, and/or other questions related to the 
person that students were describing or the place 
for which they were developing a profile. Applying 
Thorne’s (2004) proposed peer-review model, the 
aim was to develop an asynchronous peer-review 
forum, where student-initiated feedback could 
enhance learning in the two assigned genres and 
transcend the process of student-centered collab- 
orative feedback by assisting students to develop 
more complex L2 writing skills and to become 
immersed in the process of feedback provision. 
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ANALYSIS 


In total, 68 asynchronous student postings for 
paper 2 and 54 for paper 3 were analyzed. Post- 
ings for each paper appeared on different forums 
on the discussion board and were analyzed 
separately, using qualitative and descriptive data 
analysis measures. Since the study focused on 
the discourse used during ACMC and the type of 
writing strategies suggested in such exchanges, 
no attempt was made to use inferential statistical 
analysis. It is important to note that the number of 
postings analyzed for paper 3 was slightly lower 
since seven postings were eliminated because two 
students changed their tentative paper topics and 
did not incorporate their peers’ feedback. The 
remaining postings were analyzed by first tally- 
ing the total number of postings on each delayed 
forum and classifying them into two categories: 
(1) students’ discussion of their tentative paper 
topics, and (2) provision of feedback, support, 
and exchange of ideas. No distinction was made 
between asynchronous prompts that relied solely 
on suggestive feedback and prompts that focused 
exclusively on expressing support, solidarity, or 
sharing personal experiences since most asyn- 
chronous postings included a combination of these 
factors. But, the data were examined to identify 
if some students participated more extensively 
on these forums than others. 

As indicated in Table 2, peer feedback was 
analyzed further, based on the type of strate- 
gies that students employed during feedback 
exchanges: (a) describing strategies, (b) narrat- 
ing strategies, and (c) other writing strategies. 
Under describing strategies, any feedback related 
to denotative details, naming techniques, and 
comparisons was included. For example, “I am 
curious to know the kinds of goods this store 
supplies....” Any feedback that focused on the 
use of anecdotes, onetime, or recurring events 
and dialogue was perceived as part of narrat- 
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ing strategies. For example, “Should you [you 
should] use anecdotes of how he influenced you 
to become someone who believes that ‘nothing 
isimpossible’....” Any suggestions that discussed 
other writing strategies, such as organization, 
paragraphing and summarizing, were classified 
as “other strategies.” Upon determining the total 
number of suggestions for each category, a close 
analysis of each student’s draft was conducted 
to determine the total number of narrating and 
describing strategies students actually imple- 
mented to compose their rough drafts. Further, 
descriptive analysis was also used to determine 
the percentage of total narrating and describing 
strategies implemented by students. 

To analyze further the interactive modes and 
the development of individual knowledge in L2 
within acollective approach offered by the discus- 
sion board, Engestr6m’s complex model of activity 
was applied. That is, analysis perceived student 
participation as an individual action mediated by 
the written discourse on the discussion board to 
turn it into a cooperative activity among a com- 
munity of ESL writers. Following Warschauer’s 
(2005) approach, technology acted as the online 
interactive tool that allowed students to share the 
tasks and to follow the rules set for posting on 
the discussion board in an effort to improve their 
writing skills. Within this vein, then, analysis 
considered this momentary and objectified action 
of individual postings as part of a collective activ- 
ity for co-developing L2 knowledge in the ZPD. 
The development of more sophisticated writing 
skills and the desire to obtain a high score in the 
course were the main factors motivating student 
participation on the discussion board. 


RESULTS AND DISCUSSION 


Table 2 shows that the number of asynchro- 
nously-initiated postings provided by all of the 17 
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students on each forum of the discussion board 
was higher than originally anticipated. In total, 
students provided 68 postings for paper 2, where 
they described an individual who had influenced 
their life and 54 postings for paper 3, where they 
composed a profile. More specifically, a total of 
17 postings for paper 2 and 16 for paper 3 entailed 
students’ introduction, in brief statements of ap- 
proximately 10 lines, of their selected paper topics. 
For the remaining 51 and 38 postings for papers 2 
and 3, respectively, students focused primarily on 
providing feedback, either explicitly or implicitly 
suggesting narrating and/or describing strategies 
or raising questions related to their peers’ tenta- 
tive paper topics. 

This higher amount of suggestive feedback 
could be attributed to the easily accessible and 
time efficient asynchronous discussion board and 
its effectiveness in facilitating simultaneously 
multiple viewings of paper topics and feedback 
postings which could not be achieved with more 
conventional methods of feedback exchange. For 
instance, reading and selecting several of their 
classmates’ paper topics in class to offer writ- 
ten feedback. Further, the effectiveness of these 
delayed exchanges could be based on students’ 
perceptions of this feedback process as an op- 
portunity to negotiate meaning, exchange ideas, 
establish solidarity, and assist each other through 


constructive feedback. Initially, this online task 
required students to post feedback to at least one 
of the posted paper topics. However, all students 
participated in both forums, and, in many cases, 
they posted multiple feedback responses for both 
papers 2 and 3. 

Further, out of these 51 and 38 student-led 
feedback suggestions for papers 2 and 3, re- 
spectively, Chen-Chen, a shy Taiwanese female 
student, initiated the highest number of feedback 
exchanges, 10, for paper 2, followed by Sid’s and 
Ji-Hun’s seven feedback postings. Ji-Hun provided 
the highest number of postings on the discussion 
board set for paper 3, but Chen-Chen’s and Sid’s 
feedback exchanges dropped to five in the case of 
feedback exchanges for paper 3. Sid’s feedback, 
however, became more elaborate and included 
extensive suggestions. Interestingly, Ji-Hun, who 
appeared to be a rather introverted and reserved 
Korean student, utilized the written dialogic 
exchanges of these ACMC to interact with his 
classmates and to challenge them to critically 
reflect on their paper topics. There were some 
instances where students, such as Sang-Bong and 
Eduardo, offered more narrowed responses to 
their peers, and their presence was more limited 
on these forums. Nevertheless, most students 
used this asynchronously-written dialogue to 
recommend detailed suggestions which included 


Table 2. Description of asynchronous postings on the discussion board 


Ire of asynchronous posting: = #2 a #3 


(b) Provision of feedback 
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a combination of both describing and narrating 
strategies and, at the same time, maintained a 
collaborative tone. 

At the end of each forum, all students success- 
fully provided or received feedback from their 
peers that included a wide array of suggestions. 
As shown in Table 3, in total, students proposed 
119 suggestions for paper 2 and 142 suggestions 
for paper 3. Even though only 38 prompts were 
analyzed for paper 3, in comparison to the 51 
prompts analyzed for paper 2, the total number 
of student suggestions for paper 3 increased by 
23, from 119 to 142. In particular, in paper 2, 
students initiated 60 suggestions that focused 
on describing strategies, while 54 dealt with 
narrating strategies. The strategies that students 
applied in construing feedback were innovative 
and expanded beyond the rhetorical constructs 
discussed in classroom. Only five suggestions 
did not explicitly relate to narrating or describ- 
ing strategies were classified under the category 
of “other suggestions.” In retrospect, describing 
and narrating strategies corresponded to 50.4 
percent and 45.4 percent of the total number of 
suggestions, but only 4.2 percent can be attributed 
to “other suggestions.” For paper 3, the results 
were noticeably different since the focus shifted 


to describing strategies, with students proposing 
98 suggestions on describing strategies, 37 on 
narrating strategies, and seven on other related 
writing strategies. That is, describing suggestions 
formed 69 percent of the total suggestions, with 
the remaining 26.1 and 4.9 percent focusing on 
narrating and other related writing strategies, 
respectively. Further, as Table 3 shows, for both 
papers 2 and 3, students raised concrete ques- 
tions or offered suggestions that encouraged the 
use of more describing than narrating strategies, 
50.4 percent and 69 percent, respectively. This 
shift to mainly describing strategies for paper 3 
could be attributed to the fact that, for paper 3, 
students had to develop a profile, which required 
concrete field research within their community 
before describing an individual, a place, or an 
event in their profile. 

As aresult, students encouraged their peers to 
implement more describing strategies to describe 
thoroughly the role, function, or purpose that an 
organization, an event, or an individual served 
within their immediate community. For instance, 
in (1), when Amadi decided to profile “Cereality,” 
an on-campus bar and café, for paper 3, Ji-Hun 
posed three describing questions that required 
Amadi to lay emphasis on three areas: the menu, 


Table 3. Description of suggestive feedback on asynchronous postings 


Type of suggestive feedback 


(i) Describing strategies 
(denotative details, naming 
techniques & comparisons) 


(ii) Narrating strategies 


(use of anecdotes, recurring 
events, & dialogue) 
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Paper # 2 


Percentage 
of total 
suggestions 


Paper #3 Percentage 
of total 
suggestions 
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clerks, and some of the nutritional values or ad- 
vantages, as she referred to them, offered by this 
breakfast café and bar. Similarly, in (2), after Suri 
introduced the Arizona Humane Society, a local 
animal shelter, in her profile, Chen-Chen perceived 
this as an opportunity to share her love for animals 
and to suggest to Suri to implement descriptive 
details, stating how the Arizona Humane Society 
operates, such as listing the necessary steps one 
has to take to adopt an animal from this animal 
shelter. To provide students’ suggestive feedback, 
as it appeared on the discussion board, no effort 
was made to correct their grammatical and/or 
punctuation errors. Chen-Chen writes: 


1. Everyday, I pass the store withought any 
notice. Only after read your topic, I real- 
ized there is a café that you want to profile 
through this assignment. Conveying much 
information and the clerks, who are working 
there, would be very impressive woking , 
and it will make your writing more bril- 
liant. Let us know aobut the Café, such as 
the specialized menu, advantageous thing, 
and the cclerks talking. 

2. I think you’ve chosen an excellent topic for 
it is not only what you’re interested in, but 
it also provides information for those who 
are passionate in helping people as well 
as animals. I’m also an animal lover and I 
would like to visit Arizona Humane Society 
myself. If you could include as many details 
as possible, (e.g., what procedures we must 
go through to apply to adopt animals), your 
paper would be very helpful for people who 
are interested in AHS programs. 


In the case of narrating strategies, the data 
indicated that the total number of suggestions 
dropped considerably, from 45.4 percent initially 
provided for paper 2 to 26.1 percent for paper 3. 
The underlying reason behind this shift could be 
that students considered narrative strategies, such 
as the use of anecdotes and perennial events, as 


pivotal to sharing personal experiences related 
to a person that had touched their lives so pro- 
foundly, and this was then also reflected through 
their feedback. In (3), for instance, Ho-Jung, after 
reading Lutfi’s tentative paper topic on paper 2 in 
which he shared how an encounter with an elderly 
homeless man in his native country, Jordan, had 
given him a new perspective on life, provided 
three suggestions, 2 related to narrating strategies 
and 1 related to a describing strategy. 

Interestingly, Ho-Jung, who responded to 
Lutfi’s posted prompt, first attempted to relate 
this topic to his personal experiences, admitting 
that, as he grows older, he is faced with more 
complex life challenges, so he urged Lutfi to rely 
on “good annecdotes [anecdotes] and recurring 
events,” instead of physical characteristics to help 
him deal with his personal dilemmas and view 
life from a different perspective. Evidence of 
students’ suggestions relating to narrating strate- 
gies, in the case of paper 2, can also be viewed 
in (4), where Mario encouraged Victor to reflect 
on his past experiences with his grandfather to 
describe his personality. Atthe same time, through 
a single question, “His physic aspect reflected his 
personality?” [Did his physical aspects reflect 
his personality?], Mario identified the need to 
combine describing and narrating strategies to 
create a more appealing and realistic description 
of his grandfather. 


3. Wow! ’mreally curious how the old neighbor 
has influenced you. Actually, in my case, it 
seems life comes more complicated as I grow 
up. That’s why I’m interested in your paper, 
and want to get some tips to make my life 
a bit simple. I don’t think that his physical 
appearance has influenced you a lot, but 
his behaviors. With good annectodes and 
recurring events, you could give us good 
information for looking life in other vision. 
Good luck with your rough draft!! 

4. Every grandpa has something special. Im 
sure he gave you great life lessons. What did 
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ulearn from him? His physic aspect reflected 
his personality? What douremember ofhim? 
I would like to know your grandpa through 
you. Remember that important people not 
always are easy to describe. What they did 
for us is such a personal experience that 
often is difficult to share with someone else. 
Good luck with your paper. 


As shown in (4), a key element of peer 
feedback was that, through their questions and 
suggestions, students may have prompted their 
peers to employ more describing strategies, but 
most students suggested a combination of nar- 
rating and describing strategies. For example, in 
(5), when Mayoko decided to compose a profile 
on “Fujiya,” a local Japanese grocery store, Sid 
meticulously formulated his feedback to elicit the 
use of both narrating and describing strategies. Sid 
suggested that Mayoko should indicate why she 
was So interested in this grocery store, describe 
the cultural significance of Japanese symbols, and 
interview “some of the customers...to provide 
their perspective.” In essence, Sid challenged 
Mayoko to integrate her personal experiences, 
field research, and cultural factors into her paper 
to create an effective profile for “Fujiya.” 


5. This store sounds like an interesting place 
to me... What attracted you to the store? 
Do all the customers who shop there truly 
understand the significance of the various 
Japanese symbols such as white standing 
for purity? Please tell us more about the 
Japanese symbols that are in the store as 
this will help to gain a new perspective on 
Japanese culture and business. Also please 
tell interview some of the customers who 
go there and provide their perspectives on 
the store and what they like and do not like 
about the place. All the best. 


Unlike (5), however, if 1-4 are compared, it 
would appear that there were no noticeable dif- 


354 


ferences in the effort put forth by students and 
the strategies used to offer more constructive 
feedback. The only difference would be that, in 
(1) and (2), Ji- Hun and Chen-Chen directed their 
peers’ attention to specific areas, such as the 
menu, nutritional facts, the employees, and the 
processes involved in animal adoption. 


ASYNCHRONOUS FEEDBACK: 
GRADUAL INDIVIDUAL AND 
GROUP ENDEAVORS 


Nevertheless, a closer analysis of all student-re- 
lated feedback for both papers 2 and 3 indicated 
that, gradually and systematically, students trans- 
formed this peerreview activity. Thatis, there were 
considerable differences in feedback organization, 
the level of complexity in students’ language, and 
the level of sophistication in the construction of 
feedback. Most significantly, in many cases, as 
discussed in (6), feedback became more engaging 
and challenging as most students began to gain 
an in-depth understanding of the material and to 
transfer this new knowledge to pose questions that 
helped their peers reexamine their paper topics. 
Aljaafreh and Lantolf (1994), Ohta (2000), and 
De Guerrero and Villamil (2000) have also shown 
that challenging feedback can effectively engage 
students and enhance their learning experience 
in the target language. 

For example, in comparison to the feedback on 
paper 2, that is (3) and (4) above, the feedback on 
paper 3, that is (6), appears to be more construc- 
tive. In (6), Lutfi’s feedback to Eduardo’s topic 
on a BMW dealership is more specific than the 
feedback Lutfi received in (3) from Ho-Jung. In 
(6), Lutfi first organized his feedback to display 
his knowledge of and interest in BMW cars and 
then suggested to Eduardo specific questions 
to be addressed in his interview at the BMW 
dealership and later on in his paper. Lutfi’s chal- 
lenging questions were at the core of Eduardo’s 
topic, demonstrating that he had mastered the 
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strategies related to field research, notetaking, 
and the presentation of new information, so he 
applied them to formulate his feedback. Thus, 
Lutfi indicated an improvement in the production 
of written discourse by using more advanced, 
complex, and formal vocabulary in his feedback. 
These findings are also supported by Sotillo (2000) 
who indicated that asynchronous electronic ex- 
changes can enhance the level of complexity in 
students’ language. 


6. BMW...hmmm...... interesting 

I think that BMW is one of the major players 
in the luxury car market nowadays... but 
recently, I think, that they started to lose 
that position after they released the new 
first and third series of their cars. One of the 
most important questions I would ask the 
company about is that how do they look at 
the future of the car market? Is the future is 
going to be for the V-12 BMW 760iI? or is 
it going to be for the smaller V-4 cars like 
the BMW first series? Especially with the 
rocket climbing gas prices? Do they believe 
that BMW is able to stand in front of cars 
such as Jaguar, Benz, and Lexus? 


What is equally important to note is that stu- 
dents read carefully each other’s feedback and 
identified areas that were not fully explored by 
some reviewers, so they offered even additional 
feedback. For example in (7), Amadi reviewed 
Lutfi’s feedback to Eduardo and realized that Lutfi 
had not asked Eduardo to inquire information 
about the “transactions,” or the sale of BMW 
cars, at this particular dealership. Amadi even 
went further to recommend that Eduardo narrow 
down the focus of his paper to the inventory of 
cars sold at this dealership and to the description 
of the dealership. 


7. You have chosen quite an interesting place 
to talk about, but you have to be careful to 


provide only important information about 
the bmw agency. You need to get an interview 
with their manager or someone that really 
knows about the transactions that go on there 
and how these transactions are carried out. 
You also need to capture your readers atten- 
tion by using very good descriptive about 
the type of cars they sell there and how the 
place in general looks like. 


Evidence of the effectiveness in engaging 
students through reflective feedback and solicit- 
ing encouraging but also motivating responses 
also derived from a closer reading and analysis 
of each student’s paper, which indicated that 98 
of the 119 suggestions offered for paper 2, 48 
describing, 45 narrating, and five other writing, 
strategies, were implemented by students in their 
rough drafts. In the case of paper 3, 108 of the 142 
suggestions provided, 74 describing, 27 narrating, 
and seven other writing strategies were addressed 
in students’ papers. In total, 82.4 percent and 76.1 
percent of the total strategies suggested for papers 
2 and 3, respectively, were used in students’ papers. 
The percentage of implemented suggestive strate- 
gies is considerably high for both papers, and this 
could be based on the engaging and interactive 
nature of the discussion board and the provision 
of student-initiated feedback. 

To determine what actually motivated students 
to put such an effort into this collaborative activ- 
ity, a different asynchronous forum was set on 
the discussion board, where students were asked 
to assess its overall pedagogical value in helping 
them understand the material, in transferring 
these strategies in their feedback exchanges, and 
in improving their grades by composing more 
effective papers. Fifteen students evaluated the 
discussion board, and all feedback was positive. 
Students acknowledged that the discussion board 
offered a practical tool to exchange ideas and to 
read their classmates’ paper topics. As Victor 
argued in (8), 
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8. The discussion board is a very helpful tool 
allowing students to critique one another’s 
work and share ideas. I think posting ten- 
tative paper topics on the board is very 
important especially for students who did 
not take many composition courses in the 
past... 


In (9), Mayoko even admitted that asynchro- 
nous postings motivated her to plan her paper topic, 
to write coherently, and to support her claims, so 
that her classmates could understand her topic. At 
the same time, Mayoko applied more advanced 
writing strategies to devise a thesis statement and 
then to plan her paper: 


9. ... I first needed to introduce my topic in a 
very interesting way to attract the reader, 
but also, I had to be coherent with each one 
of the sentences I wanted to write because I 
am looking for my classmates to understand 
what I want to support. I can say that the 
discussion board can be seen as a practice of 
writing a powerful introduction, with main 
ideas and a thesis statement... 


Students also realized that the provision of 
feedback was a collaborative strategy which 
helped them act as a community of writers and 
identify and support students who faced more 
challenges with writing by guiding them through 
constructive feedback. As Ahmed argued, “we can 
provide more accurate feedback, share opinions, 
and we can provide advising for [we can advise] 
other students who may need lots of help.” Many 
students identified that asynchronous postings 
offered a proactive approach that helped them 
reexamine their paper topic, narrow down their 
focus, and implement strategies to conduct field 
research, and plan and organize their papers. This 
proactive approach was efficient since it was ac- 
cessible at their convenience, and there was no 
pressure to share their topics or to offer feedback 
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to their peers. Mostimportantly, as many students 
later realized, it was an online tool that helped 
them establish an online interactive forum. As 
Chen-Chen put it, the discussion board “helped 
building a bridge between us.” 


ASYNCHRONOUS POSTINGS: 
OBJECT, MOTIVE, AND OUTCOME 


The asynchronous forums, then, whether used as 
tools to formulate paper topics, to examine their 
peers’ topics and generate effective constructive 
feedback, or to evaluate how practical and valu- 
able the online forums were, provided evidence 
of a cooperative activity promoting a high level of 
engagement, motivation, and active communica- 
tion. ESL students utilized these ACMC beyond 
the course requirements in their effort to develop 
stronger writing skills and to establish a strong 
relationship between them. Using Miettinen’s 
(1999) terminology, this interactive activity al- 
lowed students to be “immersed in a new way in 
the context of knowledge use” (p.337). This activ- 
ity offered the interactive medium to students to 
(re)create the conditions of learning in L2 writing. 
The results could have been more conclusive if 
a control group had participated in this study to 
compare the results to a group of ESL students 
who had not taken part in such asynchronous 
exchanges. Further, more conclusive findings 
could have been obtained if the total number of 
students in both the control group and the group 
of students participating in ACMC was higher 
and their proposed/implemented strategies were 
classified by several trained reviewers before 
comparing the results of each group. 
Nevertheless, based on the findings of this 
study, it could be argued that the discussion board 
can effectively guide and engage ESL students 
in a constructive activity which can help them 
understand the writing assignment and expand 
beyond the conventional and individually-con- 
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Table 4. Analysis of asynchronous feedback postings based on Engestrém’s complex activity system 


Mediating Artifacts: 
Asynchronous CMC on the Discussion Board of Blackboard Vision 


Guidelines for posting tentative paper topics & providing feedback 


L2 learning (narrating & describing strategies) 


Object: 

Posting tentative paper topic 
Provision of feedback & 
Drafting of papers 
Development of better 
interrelations between 
students 


Rules: 
Implementation of 
writing strategies and 
conventions for 


Community: 


asynchronous postings 
and feedback 
collaboration 


strued modes of learning. As indicated, ESL 
students relied on certain rules that required them 
to implement the conventions and strategies re- 
lated to describing and profiling to come up with 
a paper topic and to give feedback to their peers. 
Hence, they engaged ina cooperative activity, act- 
ing as acommunity of college-level ESL writers, 
sharing the writing and feedback tasks based on 
their devised division of labor. They exchanged 
feedback and paper topics, shared ideas, and fi- 
nally composed their papers. Most significantly, 
their cooperation on asynchronous forums helped 
them acquire more complex writing strategies and 
establish a stronger connection with their class- 
mates. Table 4 applies Engestroém’s (1987, 1993, 


— 


Advanced ESL college 
students participating in 
a community of writers 


Outcome: 

CMC peer review model 
Development of conceptual 
understanding of paper topic 
Providing support & denoting 
solidarity 

Improvement in writing skills 
Expanding L2 writing skills in the 
ZPD 

Critical thinking skills 


Division of Labor: 

Posting of tentative paper topic 
Negotiation of meaning 
Provision of feedback 
Completion of rough & final draft 
Evaluation of asynchronous 
postings and peer feedback 


1999) framework to summarize the findings of 
the asynchronously-led feedback posting. 


CONCLUSION 


As the findings have indicated, asynchronous 
postings on the discussion board could provide a 
pedagogical paradigm to promote a multilayered 
approach on L2 learning by engaging students 
in a peer-feedback activity through which they 
individually and collectively enhance their writing 
skills. The theoretical-practical conditions have 
been set by the cultural-historical activity theory; 
however, the conditions for offering engaging and 
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constructive feedback in asynchronous forums 
are much more complex and have not been fully 
explored. Student participation in such delayed 
forums could from a pedagogically, institution- 
ally, and culturally meaningful activity. Hence, 
the development of such asynchronous exchanges 
could provide a motivating and challenging fo- 
rum that could facilitate the production of more 
reflective and constructive feedback. 

To explore the pedagogical and interactional 
dynamics of ESL learning within ACMC, future 
studies should lay emphasis on identifying how 
such asynchronous feedback can influence lan- 
guage development in terms of syntactic complex- 
ity, pragmatic relevance, and semantic context. In 
addition, it is important to determine if certain 
characteristics in student feedback are relevant to 
language development and if they could be suc- 
cessfully implemented in collaborative feedback 
activities, ie. identifying common interests among 
ESL students that could help them examine differ- 
ent topics. Further, focus should be placed on how 
students react to different topics and what factors 
contribute to enhanced participation in ACMC, 
Le., the use of culturally-relevant topics. Such 
models, however, should rely not on formulaic or 
linear approaches to language development but 
on identifying how different ESL students utilize 
such online delayed forums to create their learning 
experiences within collective constructs. 
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KEY TERMS 


Asynchronous Computer-Mediated Com- 
munications (ACMC): Electronic interactions 
that occur on delayed not in real time forums. 


Asynchronous Threads: Ten-line postings 
of students paper topics and proposed feedback 
facilitated by online delayed conversations on the 
discussion board. 
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Computer-Mediated Communications 
(CMC): Interactive online exchanges among 
students facilitated by computer-mediated forums 
such as the asynchronous discussion board or 
e-mails. 


Discussion Board: An electronic forum that 
forms part of Blackboard Academic Suite version 
7.0 that promotes participation and collaboration 
among students in delayed forums. 


English as a Second Language (ESL): Lan- 
guage learners whose acquire English as their 
target language. 


Peer-Feedback: Online student exchanges 
that provide suggestive comments on each other’s 
work that are aim at enhancing each other’s written 
discourse in L2 and intellectual skills. 


Student-Initiated Feedback: Suggestive 
feedback or strategies initiated by students as 
a mean to assist their peers in enhancing their 
writing assignments, that is in terms of describing 
and narrating strategies. 


Zone of Proximal Development (ZPD): 
According to Vygotsky, instruction should capi- 
talize not one’s currently accomplished or exist- 
ing competency, but on enhancing one’s future 
learning constructs that are developmentally 
feasible or can be attained through challenging 
learning activities, that is acquiring new writing 
skills in L2. 
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ABSTRACT 


One key theme in the area of computer-assisted language learning has been the potential of computer- 
mediated communication (CMC) for the language learning process. Here, CMC refers to communication 
conducted through the medium of computers connected to one another in local or global networks. It 
requires specific software tools and can be either synchronous (e.g., chat, audio- or videoconferencing) or 
asynchronous (e.g., e-mail, threaded discussion lists). This chapter explores how CMC might contribute 
to language learning and teaching. Starting off with an overview of the development of research in this 
field, a model for the analysis of successful telecollaboration procedures and processes is used for the 


discussion of a German-Australian exchange. 


FROM SYNCHRONOUS 
COMPUTER-ASSISTED 
CLASSROOM DISCUSSION TO 
COMMUNICATING IN A VIRTUAL 
CLASSROOM 


For the past 15 years, as the increasing number 
of publications on CMC in international jour- 
nals such as language learning and technology, 
ReCALL and CALL shows, research on com- 


puter-mediated communication (CMC) for the 
purpose of language learning has been highly 
topical. But whereas early studies in the field were 
focused on synchronous, written communication 
in the immediate context of the language teach- 
ing classroom, more recent definitions include 
synchronous as well as asynchronous, written as 
well as spoken, communication via the computer. 
Research on CMC has moved, in other words, 
from the actual to the virtual, in many cases 
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transnational classroom, hence the terminology: 
‘e-mail-tandem,’ network-based language teach- 
ing/learning,’and ‘telecollaboration.’ 

In the early to mid-90s, during the early phase 
of research, the focus was on synchronous CMC 
within the classroom. A seminal study was Kelm’s 
(1992) investigation of the use of synchronous 
computer networks in second language acqui- 
sition (SLA), a preliminary exploration of the 
impact of computer-assisted classroom discourse 
(CACD) in second language learning environ- 
ments. Beauvois (1992, 1995, 1998) likened the 
computer-assisted discussion between language 
learners in a classroom setting to ‘conversation 
in slow motion,’while Chun (1994) anticipated 
it would “facilitate the acquisition of interactive 
competence” (p.17) In the same vein, Kern (1995) 
compared the quantity and characteristics of dis- 
course through synchronous, written classroom 
interaction and during an oral class discussion on 
the same topic. When working online, learners had 
over twice as many turns, produced two to four 
times more sentences, and used a much greater 
variety of discourse functions than they did in their 
oral discussion. Furthermore, the distribution and 
direction of turns were radically different with 
much more direct student-to-student exchange in 
the online exchange. Both students and instruc- 
tors responded favorably to CACD. Students were 
more enthusiastic than their instructors as the 
teachers critiqued the de-centering of authority, 
the reduced focus on grammatical accuracy, and 
the relative loss of coherence and continuity of 
discussion. A later study by Warschauer (1996) 
tested the claim that one of the benefits of com- 
puter-mediated communication was its more 
equitable level of student participation by com- 
paring face-to-face with electronic discussion. 
In the context of the communicative competence 
teaching paradigm, classroom activities during 
this early phase of CMC research included dialogic 
interaction in the form of open-ended questions 
for discussion. Synchronous computer-mediated 
communication (SCMC) was seen as supporting 
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this activity because of its similarity with spoken 
communication. 

The comparison of synchronous CMC with 
face-to-face discussion revealed more active 
communication by CMC learners, with both 
more turns and more tokens produced per turn. 
Contributions by learners appeared more complex 
in terms of morphosyntax and discourse struc- 
ture while communication was more focused on 
the group than on the teacher—a trend which 
pointed toward the need for a transformation of 
the teacher’s role. 

More recently, Payne and Whitney (2002) have 
once again raised the question of whether syn- 
chronous CMC can enhance oral communicative 
competence, stating significantly better results for 
synchronous CMC learners participating in an 
experimental group. In contrast, Abrams (2004) 
found that language productions by SCMC group 
learners increased in volume but not accuracy. 
Meanwhile, Payne and Ross (2005) have sug- 
gested a connection between working memory 
and language output. These researchers have 
explored how individual differences in working 
memory capacity may affect the frequency of 
repetition and other patterns of language in chat 
room discourse. 

In the context of language education, one 
area of CMC which has generated great inter- 
est is asynchronous electronic communication 
between language learners in a virtual classroom 
(e.g., Fischer, 1998; Lamy & Goodfellow, 1999). 
This field of research has been referred to as ‘net- 
work-based language teaching’ (c.f. Lee, 2004; 
Miiller-Hartmann, 2000; Warschauer, 2000) or 
‘telecollaboration’ (Beatty & Nunan, 2004; Belz, 
2003; Greenfield, 2003; O’Dowd & Eberbach, 
2004) as well as ‘e-mail-tandem learning’ (Appel, 
1999; Appel & Gilabert, 2002; Appel & Mullen, 
2000; Brammerts, 1998; Kotter, 2003; Little & 
Ushioda, 1998; Woodin, 1997). 

The aim of this chapter is to explore how 
CMC might contribute to language learning in 
such settings. Starting off with an overview of 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


CMC and Intercultural Learning 


the principles underlying electronic tandem ex- 
changes, the potential for intercultural learning in 
telecollaborative settings is critically evaluated. 
Challenges in transnational CMC are presented 
and summarized with the help of a model for the 
analysis of successful telecollaboration proce- 
dures and processes (O’Dowd & Ritter, 2006). 
This model is then used to discuss the implications 
of those challenges for learning and teaching, 
using data from a series of German-Australian 
telecollaboration projects. 


THE VIRTUAL CLASSROOM: 
COMMUNICATING 
TRANSNATIONALLY 


Tandem language learning can be defined as a 
form of open learning where two learners with 
different languages form a partnership in order to 
practice and improve the language eachis learning. 
This is described as a form of autonomous learn- 
ing, with the focus on learning through authentic 
communication with a native speaker. Two people 
with different native languages work together in 
pairs in order to help one another improve their 
language skills but also to learn more about one 
another’s culture and to exchange additional 
knowledge, for example, about their professional 
lives. As a result, a major part of the process is 
the potential for intercultural learning. 

In tandem language learning, two main prin- 
ciples are of great importance: the principle of 
learner autonomy and the principle of reciprocity. 
The principle of learner autonomy refers to the 
proposition that learners are to determine what to 
learn and when to learn it. They themselves also 
define the level of support that is to be provided 
in the exchange, for example, the amount and 
form of corrections provided to their partner. The 
principle of reciprocity refers to mutual support 
structures, equal contributions, similar benefits 
and equal roles. In other words, learners shouldbe 


willing and able to do as much for their partners 
as they expect from them. The fact that they are 
both learners should decrease their inhibitions 
when using the foreign language, as both partners 
can be seen as specialists in one language and 
non-specialists in the other. 

The literature on information technology 
in teaching has paid a great deal of attention to 
e-mail-tandem projects (e.g., Brammerts, 1998; 
Little & Ushioda, 1998; Résler, 2000). They are 
considered to bea student-centered approach even 
though the potential for autonomous learning has 
been recognized only cautiously. For example, 
Little and Ushioda (1998) point out that language 
learners are not necessarily prepared for settings 
thatrequire autonomous learning approaches and 
Little (2001) has stressed the need for guidance. 

Within CMC foreign language education, a 
major research question has been to what extent 
on-line contact actually contributes to intercul- 
tural learning. Byram (1997), for example, has 
distinguished between communicative compe- 
tence, which focuses on exchanging information, 
and intercultural competence, which underlines 
the need to “decentre and take up the perspec- 
tive of the reader” as well as “establishing and 
maintaining relationships” (Byram, 1997, p. 3). 
Intercultural competence has also been defined 
by Guilherme (2000) as “the ability to interact 
effectively with people from cultures that we rec- 
ognize as being different from our own” (p. 297). 
Intercultural perspectives have thus highlighted 
the interconnectedness of language learning and 
culture learning (e.g., Kramsch, 1993). 

While there is little doubt that telecollabora- 
tion does have a strong intercultural learning 
potential, it seems that educators have assumed 
that merely engaging learners in e-mail exchanges 
with members of the target culture would produce 
more positive attitudes anda better understanding 
of the role of culture in language learning. This 
stance has been criticized. O’Dowd (2003), for 
example, states that: 
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Many e-mail exchanges often result in little more 
than superficial pen-pal projects where informa- 
tion is exchanged without reflection and where 
students are rarely challenged to reflect on their 
own culture or their stereotypical views of the 
target culture” (p. 121). 


TOWARDS AN EVALUATION OF 
INTERCULTURAL LEARNING IN 
CMC 


Recent publications on telecollaborative projects 
have directly addressed intercultural learning 
processes and outcomes. Furstenberg, Levet, Eng- 
lish and Maillet (2001) report on the CULTURA 
project, a Web-based, cross-cultural, curricular 
initiative “designed to develop foreign language 
students’ understanding of foreign cultural atti- 
tudes, concepts, beliefs, and ways of interacting 
and looking at the world” (p.55). Their approach is 
grounded in the belief that to understand another 
culture a learner needs more than a rudimentary 
knowledge of that other culture. What is more 
important is for the learner to develop a curiosity 
toward the culture, particularly its attitudes and 
values (Byram, 1997). In an effort to foster mutual 
understanding across French and American cul- 
tures, CULTURA offers a comparative approach 
that asks learners to observe, compare and analyze 
parallel materials from their respective cultures 
and to exchange viewpoints on these materials 
that include films, texts and online news media. 
The data was collected in the form of: 


a. Student responses to questionnaires de- 
signed to stress cultural differences with 
respect to topics such as family relations, 
power structures and work; 

b. | Online discussions of the responses to those 
questionnaires by French and American 
students as well as online discussions of the 
films and texts provided; 
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c. Student evaluations of the CULTURA 
project in the form of questionnaires, ad- 
dressing usefulness and interest for cultural 
understanding, quality of materials and ac- 
tivities, Web interface, nature and frequency 
of resources used, and general assessment 
concerning gains in understanding the target 
culture. 


The data was analyzed mainly qualitatively, 
witha descriptive account provided for categories 
(a) and (b) that focused on the positive learning 
outcomes achieved. For category (0), a quantita- 
tive analysis was carried out and is referred to in 
a qualitative manner. This again focused on the 
positive ratings given to discrete items (Fursten- 
berg et al., 2001, p. 87). 

Hanna and de Nooy (2003) examined the 
varying success of four Anglophone students of 
French who were participating in a Web-based 
forum of the French newspaper Le Monde. The 
intercultural dimension consists of a relationship 
between native and non-native speakers, rather 
than a relationship between groups of non-native 
speakers. Commenting on the fact that e-mail 
exchanges between groups of learners “are of- 
ten limited to teacher-determined topics and the 
cultural comfort zone of student-student interac- 
tion” and that “discussion list tasks tend not to be 
differentiated clearly from key-pal tasks”, Hanna 
and de Nooy (2003) suggest that in conventional 
e-mail exchanges, there is no sense of the differ- 
ence between a conversation between two people 
and a public discussion. Qualitatively analyzing 
the content of their subjects’ contributions to the 
forum, the researchers suggested that adherence 
to the rules for acceptable cultural behavior inthe 
genre ‘Internet forum’ is the measure for success- 
ful participation. In other words, competence in 
the target language, as measured by correctness 
and fluency, plays a less significant role. 

In a report on an e-mail exchange between 
Spanish and English second-year university 
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language learners, O’ Dowd (2003) identified key 
characteristics of e-mail exchanges which helped 
to develop learners’ intercultural communica- 
tive competence and outlined those elements 
which may enable students to develop successful 
intercultural relationships. Utilizing an action- 
research approach, the data collected consisted 
of participant observation, e-mail, questionnaires, 
interviews, the researcher’s self-reflective journal 
as well as peer-group feedback. The writer pro- 
vided a descriptive account of four partnerships, 
identifying specific characteristics of each which 
helped or hindered intercultural learning. The 
following characteristics were instrumental in 
helping learners develop successful intercultural 
communicative competence (O’Dowd, 2003): 


. Students had opportunities to express their 
feelings and views about their own culture 
to a receptive audience. 

. Students were encouraged to reflect critically 
on their own culture through questions posed 
by their partners. 

. Students engaged in dialogic interaction 
with their partners about the home and target 
cultures and consequently this led to a grow- 
ing awareness of differing perspectives on 
the two cultures’ products and practices. 


Healso identified those elements of e-mail mes- 
sages which enable students to develop successful 
intercultural relationships with their partners: 


. They took into account the socio-pragmatic 
rules of the partner’s language when writing 
in that language. 

. Apart from the basic information on the 
topic in question, they also provided their 
partner with analysis and personal opinions 
about the topic. 

. They asked questions which encouraged 
feedback and reflection from their partner. 

. They tried to develop apersonal (“friendly”) 
relationship with their partner, as opposed to 


simply focusing on the tasks they had been 
given. 

° They recognized and reacted to the needs 
and interests of their partners, answering 
their questions and encouraging them to 
write more about the topics which interested 
them (O’Dowd, 2003, pp. 137-138). 


Whereas the studies discussed above analyze 
learners’ contributions to online exchanges on 
a content level, Belz (2003) has put forward a 
linguistically-grounded analysis of intercultural 
competence, based on appraisal theory and epis- 
temic modality, in order to arrive at amore precise 
understanding of the social roles and interpersonal 
relationships that establish themselves in the 
negotiation of meaning: 


Appraisal theory is a Hallidayian-inspired lin- 
guistic approach to the investigation of evaluative 
language in English, which focuses on the ways in 
which lexico-grammar may operate as a site for 
the formation, dissemination, but also contesta- 
tion of speakers’ attitudinal positionings or value 
systems. Analysts interested in epistemic modality 
examine the linguistic resources speakers use in 
order to express their degree of willingness to 
commit to the truth of a particular proposition. 
(Belz, 2003, p. 70) 


Belz relates her linguistic analyses to the 
attitude component of Byram’s (1997) model of 
intercultural competence, reporting on the online 
contributions of two German and one American 
student participating ina telecollaboration project 
over a seven-week period. The three students 
were chosen in order to identify why their cor- 
respondence did not lead to intercultural learn- 
ing, where this latter concept was defined in the 
terms of developing attitudes of ‘curiosity and 
openness’ (cf. Byram, 1997). Belz concluded 
that her students were not able to establish and 
maintain functional intercultural relationships 
because they did not have sufficient knowledge 
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of culture-specific patterns of interaction in their 
partner’s language. The culture-specific patterns 
she identifies in this exchange were: 


° The performance of critique 

° The discussion of taboo topics 

° The degree of directness in conversational 
discourse 

. Linguistic devices for the mitigation of 
opinions. 


CHALLENGES IN TRANSNATIONAL 
CMC 


What these studies indicate is that the understand- 
ing of intercultural learning in online projects can 
profit from a focus on instances where intercultural 
communication did not succeed. In this respect, 
Furstenberg et al. (2001) provide an impressive 
model of a comparative approach that integrates 
parallel materials such as questionnaires, films, 
texts and online news media. Their project 
evaluation shows very positive results. Hanna 
and de Nooy’s (2003) study provides a view of 
intercultural competence as a one-way street: to 
communicate successfully, their students need to 
understand the rules of the genre ‘internet forum’ 
in the target culture, with native speakers setting 
the boundaries of what constitutes genre-specific 
culturally acceptable verbal behavior. The failure 
to behave according to the norms accepted by na- 
tive speakers is reported to lead to exclusion. Ina 
similar vein, Belz (2003) reports on a breakdown 
of communication between online partners be- 
cause of non-adherence to linguistically expressed 
cultural norms. The outcome of her linguistic data 
analysis vividly shows the interconnectedness of 
language learning and intercultural learning (cf. 
Kramsch, 2003). 

Telecollaboration projects have also shown 
a certain potential for developing autonomous 
learning. While Little and Ushioda (1998) point 
out that language learners are not necessarily 
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prepared for settings that require autonomous 
learning approaches, Little (2001) has stressed 
the need for providing guidance: 


First, learners who have experienced a pedagogy 
oriented to the development of learner autonomy 
are best placed to take advantage of the learning 
opportunities offered by such systems, since they 
know what it is to be responsible for one’s own 
learning—to select content, plan and monitor 
progress. Second, as aconsequence of the fact that 
learner autonomy is not a common reality in our 
universities, self access systems must themselves 
help learners to become self-managing and self- 
regulating. One way of doing this is by providing 
some kind of advisory service; another way is by 
offering possibilities of interaction with other 
learners. (p. 31) 


A number of telecollaboration studies have 
stressed the importance of embedding e-mail 
exchanges into structured language learning 
environments thus providing a bridge between 
the classroom and the natural language setting 
(cf. Woodin, 1997); and the need for close insti- 
tutional co-operation through the planning and 
implementation stages (e.g., Belz, 2002; Little & 
Ushioda, 1998; O’Dowd & Eberbach, 2004). In 
her analysis of ‘missed’ communication in CMC, 
for example, Ware (2005) points out differences 
in students’ expectations regarding grammatical 
accuracy, message length, andresponse time. She 
suggests that problems can be mostly avoided if 
bothteachers and students are aware of the expec- 
tations of their partners. Extensive pre-exchange 
contact with the teachers and introductory writing 
tasks which involve students telling their partners 
how they feel may go some way to increasing 
sensitivity. 

O’Dowd and Ritter (2006) developed a struc- 
tured inventory of factors which may lead to cases 
of ‘failed’ communication in online exchanges. 
In sum, ten different factors are suggested at the 
individual (here in particular the learner’s current 
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Figure 1. Inventory of reasons for failed communication in telecollaboration projects 
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level of intercultural competence (ICC), classroom 
and socio-institutional level (p. 629). 


IMPLICATIONS FOR LEARNING 
AND TEACHING 


The framework of analysis presented by O’Dowd 
and Ritter (2006) provides a useful structure fora 
discussion of teaching and learning issues in tele- 
collaboration projects. In the following sections 
those issues will be exemplified with the use of data 
collected in the context of a German-Australian 
telecollaborative project, which has beenrunning 


(4) Task Hesi 
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between 1999 and 2006 (Mollering, 2004, 2005; 
O’Dowd & Ritter, 2006). The discussion will 
move from the socio-institutional level, through 
the classroom level, to the individual level. 


Socio-Institutional Level 

Technology 

In most of its project phases, the technology 
used in the German-Australian telecollaboration 
was based on Web-CT. The exception was the 


2005 implementation phase which was based on 
MOODLE. When using Web-CT, the project site 
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was basedat the Australian university, MOODLE 
was based at the German university. Although 
the Web-CT work was considered successful, it 
required all students and instructors to be enrolled 
through the Australian university. This led to a 
different level of control over adding content to the 
project for the two project coordinators as only the 
Australian coordinator had designer rights within 
the unit. In contrast, MOODLE allowed for more 
equal access on setting up tasks and discussion 
streams. Furthermore, as an opensource platform, 
MOODLE proved to be generally very flexible and 
dynamic in offering possibilities for integrating 
new tools for asynchronous communication (e.g., 
a wiki or a voting tool). 


General Organization of the Course of 
Study 


The collaborative project investigated here follows 
Miiller-Hartmann’s (2000) appeal for thorough 
integration into a local classroom instruction 
context. Students of German were introduced to 
the facilities of a WebCT/MOODLE based unit, 
that is, they were shown how to use the bulletin 
board and e-mail facility as well as how to es- 
tablish and follow a thread on the bulletin-board. 
Their tandem partners were a group of German 
TEP (teacher education program) students of 
English, who participated in the project as part of 
the course work in a seminar on teaching English 
as a second language. These students were also 
introduced to the WebCT/MOODLE unit by their 
course coordinator who had access to the online 
unit and together with the Australianteaching staff 
monitored the project from then on. The project 
was part of the coursework set for both groups; 
the Australian students, enrolled in an advanced 
German language unit, received a participation 
mark for their contributions to the discussion list, 
while the German students’ participation in the 
telecollaboration was considered as one project of 
their seminar work, with a written evaluation to 
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be submitted at the end of the semester. A main 
focus on the German side (largely teacher train- 
ees) was to investigate the educational potential 
of such an exchange at a metalevel—thus going 
beyond the shared focus on intercultural and 
language-related learning. 

One obstacle to be overcome in the telecollabo- 
ration project’s organization was the mismatch of 
the academic calendars in Germany and Australia; 
careful planning anda certain amount of syllabus 
flexibility for the units concerned were paramount 
in order to guarantee a time slot of at least five to 
six weeks for the active exchange period. 


Prestige of Target Language and 
Culture 


Although the prestige of German, as one amongst 
many foreign languages in the Australian context 
(c.f. Clyne, 2005), and English as the main foreign 
language in the German context—a compulsory 
subject in secondary education—differ markedly, 
this has notinfluenced the level of commitment and 
contribution in this project as has been reported 
by Ware (2005) for the American participants in 
her research study. 


Classroom Level 
Teacher-Teacher Relationship 


The teachers on the German and Australian side 
cooperated very closely in setting up the project 
and in monitoring its progress. During the course 
of the project the course coordinators commu- 
nicated via WebCT’s private mail facility on a 
weekly basis in order to monitor the development 
of the project and to determine the evolvement of 
topics for discussion. In this way, the participants 
adhered to the call for close institutional co-op- 
eration (e.g., Belz, 2002; Little & Ushioda, 1998; 
O’Dowd & Eberbach, 2004). In addition to the on- 
line communication, telephone discussions were 
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necessary to fine-tune the coordination, making 
the implementation phase of the telecollaboration 
a very time-intensive part of the project. 


Task Design 


The task design for this particular German-Austra- 
lian project shifted over the years. In the first four 
project phases (1999-2004), the online exchange 
was conducted following atwofold approach. The 
Australian students formed both group partner- 
ships as well as individual partnerships with the 
German students. In this way, different kinds of 
discussion tasks would evolve during the course of 
the project (cf. Hanna & de Nooy, 2003). In both 
instances, the topics for discussion were chosen 
by the students, either individually or as a group, 
so that teacher-directed input was minimal. 


Group Communication 


As part of the preparation for the online exchange, 
the Australian students created a catalogue of 
topics for discussion. These topics were then 
addressed in collaboratively written group mes- 
sages. The German and Australian students met 
on a weekly basis to discuss topics as a group 
and to collaboratively write an e-mail to their 
partner group. The following topics for group 
discussions were suggested and discussed by 
the Australian (A) und German (G) participants. 
Many of the topics repeatedly appeared in the 
different project phases: 


. Study/University conditions 

° Part time jobs 

° International student body (G) 

. Combination of university subjects (G) 

° “Culture:” books, films, music(A) 

. Everyday life, for example, working hours, 
leisure activities (A) 

° “Mentality” (A) 

° Social and cultural identity (G) 


Individual Communication 


Due to the larger number of participants on the 
German side, the Australian students each had 
more than one individual partner. For the indi- 
vidual contributions in small groups, students 
were asked to select one topical onlinenewspaper/ 
magazine article per week—so that their partners 
would also be able to read them—for summary 
and discussion in individual messages. Students 
were also instructed to write in the target language 
in the individual partnerships and to provide 
corrections for their partners’ contributions in 
their first language, a process deemed beneficial 
to the development of their language skills (cf. 
Brammerts, 1998). 

In the context of the topic-based statements 
and questions that the students discussed in the 
individual partnerships, a pattern emerged that is 
to be seen in nearly all of the exchanges: 


. Introduction of topic 

: Australian perspective 

. Asking for German perspective 

. Trying to establish “common ground” 


In later project phases, from 2005 onwards, 
the projects were run with a task design that set 
more specific instructions and had the whole 
group discussing a set task over a period of one 
to three weeks. 

A combination of the two approaches seems 
most promising: starting off with more specific 
topics of pre-defined thematic content, and later 
on—once the tandems have established them- 
selves—leaving the choice of topics more to the 
individual groups. This allows students to set 
the focus of their discussions in their areas of 
interest. 


Learner Matching Procedures 
Because one Australian student often cooperated 


with two or three German students, the onus was 


369 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


on the Australian students ‘to keep the conversa- 
tion going’ by responding to anumber of different 
partners. In addition, in some instances there was 
an age gap between the German and Australian 
students, with a number of so-called mature-age 
students enrolled on the Australian side (c.f. 
sample data provided in the following). 


Local Group Dynamics 


The mismatch in terms of group sizes had the 
potential to lead to problems in local group dynam- 
ics on the German side if a stronger relationship 
developed between the Australian students and 
one of their German partners. On the Australian 
side, the collaborative writing sessions varied 
considerably between different phases of the 
project, with most years consisting of strongly 
student-led sessions where the teacher was asked 
for advice mainly on linguistic issues, to more 
teacher-centered sessions in one year, where the 
teacher had to frequently ask individual students 
to contribute in order to further the discussion. 

Overall, the process of collaborative writing 
and the accompanying discussions were evaluated 
particularly positively, as the following student 
comments might illustrate: 


° Relevant in terms of cooperation, social 
skills 

° You learn to lead a discussion, how to be 
part of a group, turn taking, interrupting, 
being interrupted 

. Helped to get people to contribute because 
there was a common goal at the end, people 
who do not usually contribute participated 
more 

° Real situation not a contrived situation, we 
had to work something out 


Pre-Exchange Briefing 


The main issues of pre-exchange briefings as part 
of these projects have already been discussed un- 
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der the heading of ‘teacher-teacher relationship.’ 
Nonetheless, it is worth mentioning that not all 
tasks chosen by the teachers in this project were 
equally successful, as outlined in O’Dowd and 
Ritter (2006). 


INDIVIDUAL LEVEL 


The individual level is defined as the qualities that 
the learner needs to bring to the telecollaboration 
process to facilitate positive learning outcomes. 
Two areas are of particular importance: 


. The learner’s current level of intercultural 
communicative competence 
° The learner’s motivation and expectations 


Learner’s Level of Intercultural 
Communicative Competence 


Following Byram’s (1997) model that merges 
skills, attitude, knowledge and critical cultural 
awareness as components of intercultural com- 
petence, the level of intercultural communicative 
competence students brought to the German- 
Australian exchange varied noticeably. 

The following sample of data taken from an 
exchange between a German male student in his 
twenties and an Australian female student in her 
forties illustrates this. The discussion in this phase 
of the project centers on student life in Australia 
and Germany. Students were asked to comment 
on different aspects of their life as students and to 
provide their partners with information about the 
two institutions they were enrolled in. Whereas 
most students took up this task with enthusiasm 
providing their partners with websites and photos 
of the respective institutions and expanding the 
topic into areas such as student exchanges and 
international students on campus, there was also 
the following contribution: 
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Sample Data: Contribution by German Student: 
“...Concerning the conditions of studying, I am 
upset to hear that you have to pay so much for 
education. Do you find it reasonable? You study 
for afterwards being able to contribute your part 
to society. So, those of you who don’t have rich 
parents who pay everything for you will have 
rupped up a giant degree of score [sic], won’t 
you? And then? Do you have a guarantee for 
getting a job?” 

“My personal situation will not be easy. Unfor- 
tunately I am one of the best examples of those 
people who will suffer the most. My parents do 
not have to support me from a legal point of view. 
And they do really not give a FXXX [spelled out 
by the student]. But, nevertheless, the state counts 
their income to calculate if, and in case if, how 
much Bafég I get. And guess?! It adds up to 0.00 
Euros.” 

“So I will have to pay for my flat, my food, my 
studies AND the fees. I will need to get a third, a 
fourth and maybe even a fifth job to “survive.” 
But how can anyone expect me to finish my studies 
in time? Who gives a FXXX [spelled out by the 
student]?! Nobody cares. They will, when I exceed 
the maximum number of allowed semesters, add 
penal-fees. That is fantastic. I am really looking 
forward to it.” 


There was no immediate reaction by the Aus- 
tralian students to this particular contribution. 
Furthermore, no direct response to it was made 
during the ongoing exchange while contributions 
to the task were sent in. However, in the final sec- 
tion of her final e-mail in the final project phase, 
a female Australian student in her forties, one of 
his partners, replied as follows: 


Sample Data: Reaction by Australian Student: 

“...It is sad to hear that you feel your parents 
don’t care about you. I would be very sad if my 
sons felt that way. You said I think that you were 
sharing a flat with your brother? It is good that 


you have a close family member nearby. Do you 
get on well together? 

By the way, I just wanted to say that it is not a good 
idea to use the “f---” word. It is a very impolite 
word and although you do hear it spoken especially 
between young guys, it is not considered very ap- 
propriate in written communication. Generally it 
is considered a very bad swear word and should 
be restricted in its use! That is the problem with 
foreign languages, isn’t it? I remember making 
quite a bad mistake when I was first in Germany 
as I had no feeling as to how bad a certain word 
was!!” 


The German student’s contribution was written 
with a strong orientation towards self and a very 
high level of directness and explicitness which 
the Australian students commented on in the 
classroom context, but not on the discussion list. 
Only in the final stages, when no further exchange 
was envisaged did one of them react, taking care 
to balance the directness of the criticism of using 
swear words by mitigating it through an orienta- 
tion towards the other ( “That is the problem with 
foreign languages, isn’t it?’’). 

Rather than filing this instance away as 
‘failed communication, this example may serve 
to illustrate the different cultural expectations 
of directness and explicitness in the setting of 
telecollaboration projects. 


Learner’s Motivation and 
Expectations 


Forthe most part, learners’ motivation throughout 
the different project phases was high as attested 
to by the level of project participation and the 
comments made by students in the focus groups 
and in their written project evaluations. Students 
valued in particular the authentic use of the target 
language and the level of autonomy with regards 
to choosing the topics for discussion and the em- 
phasis given to specific aspects of those topics. 
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The following selection of student comments 
illustrates this: 


° Much better than being told what to read, 
because it’s interesting to you—it makes 
you more motivated 

. It was just fun, not like an assignment, much 
more motivating, but it’s a lot of learning 

. It is learning by doing like children learn a 
language with having fun, socializing with- 
out realizing that it is actually learning 

. Summarizing of articles helped to develop 
linguistic skills 

° Good idea to practice conversational lan- 
guage with people your age 


FUTURE TRENDS 


An emerging area of research in CMC explores 
how a focus-on-form might be successfully 
integrated into collaborative projects (e.g., Pel- 
lettieri, 2000; Tudini, 2003). The 2006 phase of 
the German-Australian exchange is currently 
being evaluated with particular emphasis given 
to specific focus-on-form tasks which have been 
incorporated for the first time. The results are 
forthcoming. 

In more recent investigations of the contribu- 
tion of CMC to the language learning process, the 
focus has been on the spoken language and its 
integration with written text. This line of enquiry 
has led to the question of whether the concept of 
‘literacy’ needs to be redefined in the electronic 
age (e.g., Murray, 2000; Richards, 2000) and 
whether electronic discourse can be seen as anew 
hybrid, located somewhere between the written 
and the spoken (Muniandy, 2002). The develop- 
ment of software programs which allow for the 
concurrentuse of written and spoken modes, such 
as Lyceum, developed at the Open University in 
the UK, have spurred studies on the effective use 
of audio conferencing tools (Hampel & Hauck, 
2004) and the negotiation of interaction in text 
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and voice chat rooms (Jepson, 2005), as well as 
on more general considerations of spoken online 
communication (Felix, 2004). Mostrecent studies 
have investigated emerging technological devel- 
opments in computer-mediated communication 
such as blogs, wikis and podcasting (Thorne & 
Payne, 2005). 


CONCLUSION 


To date, the research on CMC-aided language 
acquisition shows its great potential, both for 
language and intercultural learning, provided that 
the outlined challenges are met at the socio-insti- 
tutional, classroom and individual level. Telecol- 
laborative projects need to be thoroughly linked 
with contact classes and firmly integrated into the 
socio-institutional and classroom context through 
careful planning and intensive preparation on the 
part of the teachers involved. At the individual 
level, learners need to be provided witha thorough 
introduction to a telecollaboration project to en- 
sure that their expectations match the setting and 
the given learner-match. The level of intercultural 
awareness learners bring to a project has been 
shown to impact on the success of a project but 
awareness-raising is also a crucial component of 
the learning process. Hauck (forthcoming) sum- 
marizes this point in her discussion of critical 
success factors in online exchanges: 


Moreover the increasing convergence of technolo- 
gies and the resulting surge of cognitive and affec- 
tive demands on tutors and learners underline the 
need for a more differentiated understanding of 
CMC and ICC. It also raises the question whether 
‘success or ‘failure’continue to be operable con- 
cepts in the context of online language learning 
in general and telecollaboration in particular 
and should not rather be replaced by ‘relative 
awareness gain’ with regard to both intercultural 
differences and ‘cultural characteristics’ of the 
learning environment and its use. 
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KEY TERMS 


Asynchronous CMC: The term is often used 
to refer to communication by e-mail or via a dis- 
cussion list, where the recipients of the e-mail or 
the participants in the discussion do not have to 
be present at the same time and can respond at 
their own convenience. 


CACD (Computer-Assisted Classroom Dis- 
cussion): The computer-assisted discussion be- 
tween language learners in a classroom setting 


CMC (Computer-Mediated Communi- 
cation): Refers to human communication via 
computers and includes many different forms 
of synchronous or asynchronous interaction that 
humans have with each other using computers as 
tools to exchange text, images, audio and video. 


E-Mail Tandem Learning: Asynchronous 
electronic communication between learners of 
different target languages where two people 
with different native languages work together in 
pairs in order to help one another improve their 
language skills but also to learn more about one 
another’s culture. 


ICC (Intercultural Competence): The ability 
to successfully communicate with people from 
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other cultures. ICC refers to a person’s capacity to 
capture and understand culture-specific concepts 
in perception, thinking, feeling and acting. 


Synchronous CMC: The term is often used 
to refer to communication in a chat room or via 
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videoconferencing, where the participants have to 
be present at their computers at the same time. 


Telecollaboration: Asynchronous electronic 
communication between language learners in 
different locations in a so-called virtual class- 
room. 
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ABSTRACT 


Research on CALL environments that explicitly focuses on the development of strategic competence is 
almost non-existent. This chapter reports on an exploratory study which was conducted as a semester- 
long, Web-based project to facilitate the development of L2 strategic competence by means of online 
collaboration among advanced EFL (English as a foreign language) learners who are students in an 
EFL teacher education program at a German university. The project—called the “Online Learner 
ABCs”—combines an autobiographic approach to raise the learners’ awareness of their own strategy 
use with data-driven activities to foster diagnostic skills with regard to strategy use. Overall, the “Online 
Learner ABCs” was found to be conducive to the students’ development of L2 strategic competence, in 
particular by raising the students’ awareness of a considerable number of language learning strategies. 
Deep-level reflections on strategy use, however, remained scant, indicating that further instructional 
fine-tuning is needed. 


INTRODUCTION which second language learners employed when 

their linguistic prerequisites were not adequate 
Research on L2 strategic competence has become (Selinker, 1972; Varadi, 1980). That is, speech 
a continuous effort since the 1970s. In the begin- production and the mismatch between commu- 
ning, the focus was on communication strategies nicative intentions and linguistic resources were 
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emphasized (Bialystok, 1990; Canale & Swain, 
1980; Feerch & Kasper, 1983; Rababah, 2002; 
Stern, 1983). 

In the 1980s and 1990s, the need for life-long 
learning triggered another perspective on L2 
teaching objectives (Finkbeiner, 2005), and along- 
side it research on the cognitive and metacognitive 
aspects of autonomous L2 learning. These devel- 
opments have been reflected in language learning 
strategy research (Cohen, 1998; Finkbeiner, 1998, 
2005; O’Malley & Chamot, 1990; Oxford, 1990, 
1996; Rababah, 2002; Rubin, 1975). Mostrecently, 
a group of renowned L2 strategy researchers has 
initiated the International Project on Language 
Learner Strategies (IPOLLS) as a comprehen- 
sive effort to further advance language learner 
strategy research (Cohen & Macaro, 2007). This 
chapter links up with IPOLLS’s work on learning 
strategies and situates it in a collaborative online 
environment. 

Given the long-standing tradition in L2 
learning strategy research, it is surprising that 
empirical studies looking at the intersection with 
CALL (computer-assisted language learning) 
have remained rather scant. For example, when 
consulting the ERIC (Education Resources Infor- 
mation Center) database, a search for (empirical) 
research reports yields a total of 29 publications 
(as of June, 2007) based on database queries us- 
ing combinations of the following descriptors: 
“English (second language),” “foreign language 
instruction,” “foreign language learning,” “for- 
eign language teaching,” “language learning 
(foreign),” “second language instruction,” “second 
language learning,” “computer assisted instruc- 
tion,” “computer-assisted learning,” “intelligent 
computer-assisted instruction,” “computer uses in 
education,” “communication strategies,” “learner 
strategies,” publication type: “reports research.” 
As will be evident from the literature review fur- 
ther below, research on CALL environments that 
explicitly focuses on the development of strategic 
competence is almost non-existent. 
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In order to begin filling this void, this chapter 
reports on a semester-long, Web-based project to 
facilitate the development of L2 strategic com- 
petence by means of online collaboration among 
advanced EFL (English as a foreign language) 
learners who are students in an EFL teacher educa- 
tion program at a German university. The project 
uses the “Online Learner ABCs” as a vehicle to 
promote reflection on one’s own language learning 
history as well as on language learning strategy 
use. It is an adaptation of the ABCs of cultural 
understanding and communication (Finkbeiner 
& Knierim, 2006; Finkbeiner & Schmidt, 2006; 
Schmidt, 1998; Wilden, 2006). The “Online 
Learner ABCs” project designed here employs an 
autobiographic approach (Schmidt, 1998; Schmidt 
& Finkbeiner, 2006) together with the LMRplus 
approach (Finkbeiner, 2001, 2004), which is a 
professional tool that aims at raising learners’ 
awareness of their own strategic competence. 


LANGUAGE LEARNING 
STRATEGIES 


The core question of the “Online Learner ABCs” 
project is, first ofall, whether and, secondly, how 
learners’ L2 strategic competence can be fostered 
through online collaboration. Therefore, we will 
first define the key construct “strategic compe- 
tence” and then examine how this notion has been 
taken up in the CALL community so far. 
Following Cohen (1998), one can distinguish 
between “language learning strategies” and 
“language use strategies” as being two subsets of 
“language learner strategies.” It should be noted, 
though, that the distinction between language 
learning strategies and language use strategies is 
not always clear-cut in that the latter (e.g., a com- 
munication strategy such as circumlocution) can 
also contribute to L2 learning (e.g., acquisition 
of a new lexical item based on an interlocutor’s 
circumlocution). In the SLA (second language 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Developing L2 Strategic Competence Online 


acquisition) literature, the term “strategic com- 
petence” has predominantly been associated with 
learners’ communicative language ability, as 
evidenced in the following definition by Bach- 
man (1990): 


Strategic competence is seen as the capacity 
that relates language competence, or knowledge 
of language, to the language user’s knowledge 
structures and the features of the context in which 
communication takes place. Strategic competence 
performs assessment, planning, and execution 
functions in determining the most effective means 
of achieving a communicative goal (p. 107). 


Bachman’s definition addresses only one sub- 
set of language learner strategies, namely strate- 
gies of language use, leaving aside Cohen’s (1998) 
second subset, that is, language learning strategies. 
To arrive at a more comprehensive definition of 
strategic competence, we would therefore like to 
extend Bachman’s definition as follows: 


1. Strategic competence is seen as the capacity 
thatrelates language competence, or knowl- 
edge of language, to the language user’s 
knowledge structures and the features of the 
context in which not only communication 
but also language learning takes place. 

2. Thus, strategic competence performs as- 
sessment, planning, and execution functions 
in determining the most effective means of 
achieving a communicative goal on the one 
hand and a language learning goal on the 
other hand. 

3. Furthermore, we argue that L2 strategic 
competence can enhance the language learn- 
ing process by connecting, in a synergetic 
manner, declarative L1, L2, L3, etc. knowl- 
edge (knowing about the L1, L2, L3, etc.), 
procedural L1, L2, L3, andsoon, knowledge 
(knowing how to use the L1, L2, L3, etc.), 
and conditional knowledge (knowing how to 


use the L1, L2, L3, etc. in a specific context) 
(Brown, 1987; Finkbeiner, 2005; Garner, 
1990). 


Based on this more comprehensive notion of 
L2 strategic competence, this chapter specifically 
focuses on language learning strategies (and 
not on language use strategies). According to 
Oxford and Schramm (2007), a language learn- 
ing strategy is “a specific plan, action, behavior, 
step, or technique that individual learners use, 
with some degree of consciousness, to improve 
their progress in developing skills in a second or 
foreign language” (pp. 47-48). This represents but 
one of numerous definitions that have been put 
forward over the last three decades. It is neces- 
sary, therefore, to be aware of the fact that there 
is still a lack of terminological coherence and 
consensus in the field oflearning strategy research, 
including the discussion of criterial features of 
language learning strategies (Finkbeiner, 1998). 
For instance, Oxford and Schramm’s definition 
conceives of learning strategies as exhibiting 
“some degree of consciousness,” which is in 
line with Finkbeiner’s (1998, 2005) proposal to 
situate learning strategies along three continua: 
from conscious to unconscious, from explicit to 
implicit, and from observable to non-observable. 
Cohen (1998, p. 4), in contrast, emphasizes that 
“the element of consciousness is what distin- 
guishes strategies from those processes that are 
not strategic.” A full discussion of this issue and 
related matters is beyond the scope of this chap- 
ter, but readers need to be cognizant of possible 
caveats in learning strategy research emanating 
from the current state in the field, which clearly 
necessitates further research. 

According to O’Malley and Chamot’s (1990) 
taxonomy of language learning strategies, one can 
distinguish between cognitive, metacognitive, and 
social and affective strategies: Cognitive strate- 
gies (such as repetition, translation, summarizing, 
resourcing, elaboration, or inferencing) “involve 
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interacting with the material to be learned, ma- 
nipulating the material mentally or physically, or 
applying a specific technique to a learning task” 
(O’Malley & Chamot, 1990, p. 138). Metacogni- 
tive strategies (such as planning, selective atten- 
tion, self-monitoring, or self-evaluation) “involve 
thinking about the learning process, planning 
for learning, monitoring the learning task, and 
evaluating how well one has learned” (O’ Malley 
& Chamot, 1990, p. 137). Social and affective 
strategies (such as cooperation, questioning for 
clarification, or self-talk) “involve interacting with 
another person to assist learning or using affec- 
tive control to assist a learning task” (O’Malley 
& Chamot, 1990, p. 139). 

Chamot and O’Malley (1994, p. 372) argue 
that the efforts of language learning strategy 
research rest on the assumption that “explicit meta- 
cognitive knowledge about task characteristics 
and appropriate strategies for task solutions is a 
major determiner of language learning effective- 
ness” (Chamot & O’Malley, 1994, p. 372). As 
we have seen, there is quite some discrepancy in 
the discussion of the role of dimensions such as 
explicitness, implicitness and so on. Furthermore, 
many L2 learners do not use strategies when left 
at their own devices, or at least they do not use 
them effectively. This can be due to affective 
factors, such as fear of failure (Covington, 1985, 
1997), but also due to difficulties in judging and 
evaluating the dynamics of situated and adequate 
strategy use (Finkbeiner, 2005, p. 421). This ob- 
servation has given rise to research on and the 
implementation of learning strategy instruction, 
driven by the argument that L2 learning can be 
more effective “if students become more aware 
of the range of possible strategies that they can 
consciously select during language learning and 
language use” (Cohen, 1998, p. 65). To this end, 
Cohen (1998) outlines the following goals of 
learning strategy instruction: 


1. Self-diagnose their strengths and weak- 
nesses in language learning; 
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2. | Become more aware of what helps them to 
learn the language they are studying most 
efficiently; 

3. Develop a broad range of problem-solving 
skills; 

4. Experiment with both familiar and unfa- 
miliar learning strategies; 

5. Make decisions about how to approach a 
language task; 

6. Monitorandself-evaluate their performance; 
and 

7. Transfer successful strategies to new con- 
texts (pp. 66-67). 


To implement these goals of learning strategy 
instruction, highly individualized, learner-cen- 
tered, context- and task-specific learning scenarios 
can prove beneficial (Finkbeiner, 2005, pp. 424- 
478). As a first step, learners should be guided 
to become aware of their own language learning 
processes and behaviors. For this reason, most 
approaches to strategy instruction include an 
awareness-raising component as their fundamen- 
tal building block (e.g., Chamot, Barnhardt,El-Di- 
nary, & Robbins, 1996; Cohen, 1998; Finkbeiner, 
2005; Oxford & Leaver, 1996; Yang, 1996). The 
project described inthis chapter focuses explicitly 
on awareness raising as the participants’ start- 
ing point on the way to becoming strategically 
competent L2 learners. 


STRATEGIC COMPETENCE AND 
CALL 


Let us now turn to the question in what ways L2 
learning strategies (asa component of L2 strategic 
competence) have been addressed in the area of 
CALL. When examining the relevant literature, 
the following categories of studies emerge: 


1. Descriptive studies. Studies in this cat- 
egory examine learners’ strategy use during 
CALL activities which are not specifically 
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geared toward fostering learners’ strategic 
competence; taken as manifestations of 
actual learner behavior. The results of this 
type of study are typically used to make 
informed decisions as to how the design of 
the CALL activity under investigation can 
be improved. 

2.  Interventionist studies. Studies in this cat- 
egory are based on CALL activities which 
specifically aim at fostering learners’ strate- 
gic competence; they are interventionist in 
that the CALL activity under investigation 
seeks to influence the students’ learning 
processes and behaviours (e.g., by elicit- 
ing strategy use, by raising the learners’ 
awareness of strategies). It should be noted, 
however, that two of the studies listed in 
Table 1 (i.e., Barnes,Medina, Plaskoff, & 
Robertson, 1990; Bull, 1997) are pilot stud- 
ies which describe the intended intervention 
(e.g., task design, software features) without 
implementing and testing it empirically. 


Among these studies one can further distin- 
guish between studies within the computer-as- 
tutor vs. computer-as-tool framework: “With a 
CALL tutor, a computer program analyzes and 
evaluates an individual learner’s response to a 


question, and provides feedback on it” (Levy & 
Stockwell, 2006, p. 22) whereas “with computer 
tools the role of the technology is best described 
as an ‘enabling’ device” (Levy & Stockwell, 2006, 
p. 24). For example, in the latter scenario, the 
computer provides and facilitates access to dic- 
tionaries and other databases, electronic writing 
and publishing environments (e.g., wikis, blogs), 
as well as means of computer-mediated commu- 
nication (CMC; e.g., e-mail, forums, text/voice 
chat, MOOs). 

Table 1 contains references to studies repre- 
senting each of these categories. In line with this 
chapter’s focus on the development of strategic 
competence (rather than the mere description of 
strategy use), we will now review selected inter- 
ventionist studies in more detail. 


Interventionist Studies Within the 
Computer-As-Tutor Framework 


In an early interventionist study, Barnes et al. 
(1990) describe the development of software 
which aims at supporting ESL (English as a sec- 
ond language) students’ essay planning skills by 
focusing on task-specific metacognitive strategies. 
The software raises the students’ awareness of ef- 
fective essay planning strategies (e.g., techniques 


Table 1. Studies on learning strategies in CALL environments 


Type of study Purpose/studies 


Descriptive studies 


Descriptive studies investigate strategy use during CALL activities which do 


not specifically aim at fostering learners’ strategic competence 
Aharony (2006), Duquette (1999), Freese (1997), Jamieson and 
Chapelle (1987), Knierim (2001), Liou (1997), Liu and Reed (1994), 
Peterson (2006), Smidt and Hegelheimer (2004), Ulitsky (2000), 
Vincent and Hah (1996), Vinther (2005), Yeh and Lo (2005) 


Interventionist studies 


Interventionist studies investigate CALL activities which specifically aim at 


fostering learners’ strategic competence 
Barnes et al. (1990), Bull (1997), Chang (2007), Hauck (2005), 
Knierim (2000), Ma and Kelly (2006), Meskill (1991) 
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to organize one’s ideas). Several essay planning 
strategies are described and practiced, and their 
usefulness regarding the different stages of the 
writing process is highlighted. However, since 
this study is primarily concerned with the design 
of the program, Barnes et al. do not make any at- 
tempt to assess learners’ development of strategic 
competence by using their software. 

Bull (1997) reports on the development of an 
intelligent CALL program, called Mr. Collins, 
which aims at raising learners’ awareness of 
learning strategies for specific language learning 
exercises (e.g., pronoun placement). Based on indi- 
vidual learners’ profiles as well as the interactions 
between the learner and the software (e.g., learner 
errors and learner self-assessment), Mr. Collins 
introduces selected strategies. Furthermore, 
students are encouraged to request information 
about alternative strategies. The primary aim is 
to “encourage a learner to reflect on what may 
work best for him as an individual” (Bull, 1997, 
p. 31). Like Barnes et al. (1990), Bull (1997) does 
not refer to any empirical data that would eluci- 
date to what extent the software authors’ design 
decisions result in improving students’ strategic 
competence in practice. 

Knierim (2000) describes the development of 
a Web-based listening/viewing task for beginning 
university-level learners of German (N = 20). To 
facilitate the students’ comprehension, the Web 
environment provides technology-enhanced 
scaffolding (e.g., pausing/reviewing video clips 
at will, listening to key words from each section 
of the video clip, access to an online dictionary) 
and strategy-based pre-listening activities. Each 
segment of the video clip was preceded by strat- 
egy-based pre-listening activities which were 
supposed to elicit context-specific strategies such 
as personal/world elaboration, voice/paralinguis- 
tic inferencing, and summarization (Knierim, 
2000, p. 22). To raise the students’ awareness of 
how the strategy presented can be helpful, the 
rationale of each of these activities is explained. 
Knierim (2000) found that “the students who 
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received only technological support or no support 
at all performed best, followed by the group with 
technological plus strategic support” (p. 32), while 
the students provided only with strategic support 
performed worst. These results were taken to 
indicate that the beneficial effect of technological 
support during the listening task investigated may 
have been more immediate; in contrast, strategic 
support may require more extensive practice in 
order to take effect. 

Ma and Kelly (2006) describe the principled 
development of a vocabulary learning program 
called WUFUN for Chinese EFL learners. One 
of the program’s features are word memorization 
aids which provide advice on how the vocabulary 
covered by the program can be memorized by 
introducing strategies such as verbal association, 
imagery, and rhyming (Ma & Kelly, 2006, p. 26). 
The authors examined the question whether the 
learners were able to develop vocabulary learning 
strategies while using the program by asking the 
participants (N = 35) to indicate which, if any, 
strategies they acquired from using the software. 
Ma and Kelly (2006) found that “most learners 
mentioned just one or two strategies” and that “the 
learners tend to adopt the strategies that require 
less mental effort” (p. 37). The authors concluded 
that in future versions of the software vocabulary 
learning strategies instruction would have to be 
made more explicit. 


Interventionist Studies Within the 
Computer-As-Tool Framework 


In a study by Meskill (1991), ESL students (N = 
34) worked with a student-controlled database 
of video sequences which contained syntactic, 
semantic, pragmatic, and cultural information 
about English conversation strategies. To facilitate 
the students’ interaction with the video sequences 
in a strategic manner, several kinds of advice 
messages were displayed by suggesting the use 
of strategies such as rehearsal, monitoring, plan- 
ning, association, and resourcing (e.g., by using 
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the program’s dictionary). The advice messages 
were in the form of “Why don’t you try ...” or 
“Think about ....’ However, the performance 
scores of students receiving the advice messages 
and of those who did not receive the strategic 
advice were not statistically significantly differ- 
ent. Yet, additional qualitative data obtained from 
follow-up interviews suggested that most students 
were “inclined to attend to and follow suggestions 
concerning how to interact with the multimedia 
content presentation with weaker strategists at- 
tending more closely to and desiring more of the 
same kind of advice” (Meskill, 1991, p. 286). 

Chang (2007) describes a Web-based instruc- 
tional program focusing on EFL reading, which 
was embedded in an online course management 
system. To facilitate the students’ use of meta- 
cognitive strategies, they were required to fill in 
a self-monitoring recording form prior to begin- 
ning their online course work. The form asked 
the students, who were enrolled at a Taiwanese 
college (N = 99), to record: 


1. Their starting time, 
The place from where they were accessing 
the course, 

3. Any persons they were studying with, and 

4. Aprediction of theirscore onan after-lesson 
quiz (Chang, 2007, p. 190). 


After finishing a session, the students were 
also requested to indicate 


5. Their finishing time, 

The actual quiz score, and 

7. | Anything which distracted them from the 
learning process (Chang, 2007, p. 190). 


m 


Whenever a student began a new session, he 
or she was shown her learning history based on 
the information gathered from the self-monitoring 
recording form. It was found that the students who 
worked with the Self-Monitoring Recording Form 
performed statistically significantly better (as 


measured by comprehension tests, assignments, 
and discussions) than students who were not 
provided with this component of the Web-based 
course. Chang (2007) concluded that: 


Students’ monitoring of their study time and the 
learning environment helped them complete the 
academic task and alerted them to any breakdown 
in attention or comprehension; the test-predicting 
strategy provided students with opportunities to 
evaluate their own learning (p. 194). 


These positive results are especially notewor- 
thy given the relative simplicity, both methodologi- 
cally and technologically, of the treatment, that 
is, the self-monitoring recording form. 

In the context of distance language learning, 
Hauck (2005) investigated the development of 
metacognitive strategies through online activities 
which relied on the “elicitation of learners’ self- 
and contextual knowledge and beliefs, articulation 
of what has come to awareness, confrontation with 
alternative views, and reflection on the appropri- 
ateness of revising, expanding one’s knowledge” 
(Hauck, 2005, p. 74, referring to Wenden, 1998; 
emphasis in original). Following these principles, 
Hauck utilized task-based activities focusing on 
individual learners’ skills and how these may be 
best utilized (or further improved) in Web-based 
distance language learning. Over a period of five 
weeks, the tasks were performed in group or pair 
work, mediated by a tutor, within a virtual learn- 
ing environment which allowed for audio-graphic 
conferencing among the participants (N = 14). 
To evaluate the students’ metacognitive growth, 
Hauck analyzed observation protocols of the learn- 
ers’ verbal interactions as well as the learners’ 
reflective comments on each session. Moreover, 
a questionnaire inquiring about the learners’ 
“self-awareness as well as their awareness of 
their individual approaches to language learning 
online” (Hauck, 2005, p. 75) was administered 
upon completion of the project. Based on these 
data Hauck concluded that the approach taken in 
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her study “can enhance the cognitive capacities 
underlying effective LSM [learner self-manage- 
ment]” (Hauck, 2005, p. 79) as well as learners’ 
strategic knowledge (Hauck, 2005, p. 80). 

In sum, when looking at the interventionist 
studies on learner strategies in CALL environ- 
ments, we can observe the following (see Table 
2): Thenumber of interventionist studies—thatis, 
studies focusing explicitly on fostering students’ 
use of strategies or strategic competence as a 
whole—is still very small (see also Table 1). Not 
all of the interventionist studies identified in the 
CALL literature, which has been reviewed above, 
are empirical but are merely “design studies.” The 
results of studies which investigate the relation- 
ship between the elicitation of learning strategies 
by means of a CALL task and learners’ task 
performance are mixed, which is in line with the 
still ongoing debate on the empirical validation 
of the relationship between strategy knowledge/ 
use and achievement (Friedrich & Mandl, 2006). 
While Knierim (2000) and Meskill (1991) did not 
yield any conclusive evidence, only the results of 
Chang (2007) are more positive, indicating that 
the approach taken in that study (i.e., by fostering 
students’ self-monitoring strategies) does indeed 
improve learning outcomes. Only two studies from 
the CALL literature (Hauck, 2005; Ma & Kelly, 
2006) have been identified as attempting to assess 
learners’ development of strategic competence. 


Developing L2 Strategic Competence Online 


Based on this review of studies focusing on 
learning strategies in CALL environments, the 
need for empirical research on the development 
of L2 strategic competence is clearly evident. In 
addition to learners’ self-reports on perceived 
changes in strategic competence, CALL strat- 
egy research needs to devise ways of rendering 
strategy knowledge and use visible so as to be 
susceptible to observation. Furthermore, given the 
recent developments in CALL which emphasize 
using the computer as a tool for L2 learning (as 
opposed to a tutor), the lack of research on strate- 
gies in computer-as-tool CALL is significant. In 
particular, this holds true for Web-based CALL 
activities which make use of a broad range of 
online communication and collaboration tools, 
such as e-mail, forums, chat (text-based and voice), 
instant messaging, MOOs, blogs, podcasts, and 
wikis (for recent overviews, see, e.g., Fotos & 
Browne, 2004; Hegelheimer & Knierim, 2006; 
Levy & Stockwell, 2006). 


THE “ONLINE LEARNER ABCS” 


The present study seeks to address the above iden- 
tified gap in current CALL research by reporting 
on a semester-long project with 34 students (30 
female, four male) ina graduate-level seminar on 
“language learning strategies” in an EFL teacher 


Table 2. Characteristics of interventionist studies on learner strategies in CALL environments 


Computer as 


Assessment of 


Study Empirical N : 
tutor tool L2 performance strategic competence 
Barnes et al. (1990) v - = . 2 
Bull (1997) v = 2 7 7 
Knierim (2000) v v 20 v “ 
Ma & Kelly (2006) v v 35 Z v 
Chang (2007) v v 99 v : 
Hauck (2005) v v 14 2 v 
Meskill (1991) v v 34 Z 
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education program at a German university. The 
participants are advanced learners of English as 
a foreign language. The “Online Learner ABCs” 
aimed at facilitating the students’ strategic com- 
petence by supplementing the face-to-face classes 
as a blended learning project. 


INSTRUCTIONAL DESIGN OF THE 
PROJECT 


The pedagogical considerations underpinning 
the project are firmly grounded in constructivist 
and experiential approaches to foreign language 
education (Finkbeiner, 2000, 2005; Legutke & 
Thomas, 1991; Van Lier, 1996; Vygotsky, 1962, 
1978). Specifically, the project is based on the 
following models and approaches, respectively: 


The LMRplus Model 


In the LMRplus model (Finkbeiner, 2001, 2004), 
L stands for learner, M for moderator, and R for 
researcher. The model focuses on “cooperation and 
collaboration among the changing roles of teacher 
and learner and researcher” (Finkbeiner, 2004, p. 
114) as well as the different sets of competencies 
and strategies that one needs foreach of these roles. 
Furthermore, it suggests that every participant 
in an educational setting can optimize his or her 
learning experience by assuming all three roles 
(e.g., during the course of a semester project and 
by developing the role-specific strategic compe- 
tencies). The “plus” in the model refers to the fact 
that the foreign language (in this case, English) is 
used as the vehicle for classroom communication, 
thus rendering a subject-matter course (i.e.,on EFL 
teaching methodology) into a content-based lan- 
guage classroom. The LMRplus model provides 
the overarching framework for the present study, 
since students will act as learners, moderators, 
and researchers throughout the project. 

With regard to CALL, Finkbeiner (2001) 
examined the impact of the LMRplus model in 


two studies: (a) a qualitative study in an intensive 
tutorial program (N = 8) and (b) a qualitative- 
quantitative survey study with groups inside and 
outside a CALL environment (N = 82). A special 
focus was on CALL novices vs. CALL experts. 
By means of a questionnaire “students’ attitudes, 
experience and concrete behavior in different 
situations concerning CALL and cooperation” 
were investigated (Finkbeiner, 2001, p. 138). The 
most striking result was that attitudes towards 
cooperative learning in a CALL environment 
were filled with great skepticism in all groups. It 
was remarkable that the CALL novices expressed 
more apprehension as to cooperation in a CALL 
environmentthan the CALL experts (Finkbeiner, 
2001, p. 145). The study showed that processes 
such as organization, planning, initiation, facili- 
tation, and evaluation of a collaborative CALL 
classroom seem to be key in contributing to more 
positive attitudes towards cooperative learning 
in a CALL environment (Finkbeiner, 2001, p. 
145). Furthermore, there was a gender issue with 
female students favoring cooperation ina CALL 
environment more than male students. 


The ABCs Model of Intercultural 
Understanding and Communication 


The first phase of the project utilizes and adapts 
the ABCs Model of Intercultural Understanding 
and Communication (Finkbeiner, 2006; Fink- 
beiner & Koplin, 2002; Schmidt, 1998; Schmidt 
& Finkbeiner, 2006) which originally aims at 
exploring cultural and intercultural differences 
through a three-step process involving two indi- 
viduals from different cultural backgrounds. The 
three steps are: 


1. A: Writing an autobiography. In the ABCs 
process, the autobiography is written in the 
mother tongue. It is considered a protected 
text which is immune to criticism, feedback 
and/or correction. It is individual and private 
and, thus, not shared with the partner; yet, 
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Table 3. Instructions for the “online learner ABCs” 


Step Instructions 


A Writing a Learner Autobiography 
List and describe memories, starting with your earliest, as they relate to learning, literacy development, 
and language learning—inside and outside of school. Upload your autobiography by clicking on the link 
provided on the course Web site. Expected length: 200-500 words (more if you want to) in English. 


B Writing a Learner Biography about Your Partner 

*Interview” your partner regarding his or her memories, starting with the earliest, as they relate to learning, 

literacy development, and language learning—inside and outside of school and write a learner biography 

about him/her. The process is reciprocal: You will write a biography about your partner, and he/she will 
write one about you. 

The “interviews” will be conducted on our course Web site (OCCO) using 
1. Chat rooms 
2. Forums 

The basic idea is to use the more fast-paced communication in the chat room to generate ideas you would 

like to talk about, to quickly exchange your opinions, and so on. The forum is more suitable for substantial 

answers, comments, reflections, and so on. 

After communicating with your partner, you will write a learner biography about your partner based on 

the information he or she provided during the chat sessions and forum discussions. Expected length of the 

biography about your partner: 200-500 words (more if you want to) in English. 

To conclude Step B of the learner ABCs, you are going to review the biography which your partner wrote 

about you. Also, you are going to revise the biography which you wrote about your partner. This process 

will be implemented on the OCCO course Website using a so-called wiki, which is an online tool for 
collaborative writing. 

Please look at the biography your partner wrote about you and review it by examining the following: 

* Content: Does your partner present your ‘life story’ as a language learner in an appropriate way? Are 
there any misrepresentations or inaccuracies? Also, are there any additional points that, from your 
point of view, would be important or interesting to add? 

* Language: Since we all English as a foreign language, it is always beneficial to check one’s language 
for appropriateness and correctness. Please highlight any language problems you notice. You do not 
need to provide the corrections but you may wish to add a comment. 

¢ Finally, please revise the biography which you wrote about your partner (based on your partner’s 
feedback). Please address any remarks, questions, and so on raised by your partner, and fix any 
language problems highlighted by your partner. 


G Comparing Learner Biographies 

* Compare your own autobiography with the biography your partner wrote about you: Look carefully at 
HOW your partner describes the events and experiences from your life story as a (language) learner. 
Are there any subtle, “hidden” comments or interpretations in what your partner wrote about you? 
How do your partner’s perceptions of certain events, experiences, or learning processes in your life 
story as a (language) learner differ from your own perceptions (cf. your autobiography)? How might 
all this be related to learner-specific behaviors, values, and beliefs? 

* Compare your own autobiography with the biography you wrote about your partner: Do you see any 
interesting similarities in your partner’s and your own life story as a (language) learner? For example, 
are there similar experiences, events, or learning processes that were/are important in your lives? In 
what respect, precisely, are these “similar” experiences (really) similar, or how do they maybe differ 
after all? On the other hand, are there any striking events or experiences (“critical incidents”) in your 
partner’s life story as a (language) learner that would be unlikely to be part of your own life story 
as a (language) learner? Or, are there any striking events, experiences, or learning processes in your 
partner’s life that, in all likelihood, would have a different meaning, relevance or impact in your own 
life as a (language) learner? Do you see any connection to learner-specific behaviors, values, and 
beliefs? 

* Write down (in English) the findings from your comparisons post them in the forum for Step C. Only 
you and your ABCs partner have access to this forum. Respond to your partner’s comparison results 
(in this forum), comment on them, and ask for clarification (if necessary). (NB: If you wish, you can 
schedule another chat session with your partner to discuss your findings.) 
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as part of the assignment it has to be shared 
with the teacher. 

2. B: Interviewing the partner to write a biog- 
raphy about him or her. This text is written 
in the target language, it is shared, feedback 
by the partner is possible (see point 4.). 

3. | C: Comparing the autobiography of oneself 
with the biography about the partner (and, 
optionally, the partner’s biography about 
oneself) to explore cultural differences and 
similarities as well as self- and other-percep- 
tion. This part of the assignment is written 
as an academic paper in the target language. 
It is evaluated with respect to the depth of 
metacognition, awareness, and reflection 
on the perception of the self and the other 
(Finkbeiner, 2006, pp. 35-39). 

4. The European adaptation (extending the 
original ABCs model by Schmidt, 1998) in- 
cludes a fourth step: validating the biography 
by re-reading the biography and allowing 
each partner questions for clarification and 
feedback (Finkbeiner & Koplin, 2002). 


For the purposes of the present study, the ABCs 
model is used to explore similarities and differ- 
ences in the participants’ life stories as learners 
within the framework of their individual “learn- 
ing cultures.” The special focus thereby lies on 
L2 learning and L2 learning strategies. As in the 
original ABCs model, the “Online Learner ABCs” 
is done in learner dyads. However, in contrast to 
the original ABCs model, which is conducted in 
a face-to-face environment, the “Online Learner 
ABCs” has been adapted to the online environ- 
ment (for further attempts to utilize the ABCs 
model in online scenarios, see Finkbeiner & 
Knierim, 2006; Knierim, 2006; Knierim, Wade, 
& Wilden, 2004; Wilden, 2006, 2007). 

The goal of this phase of the “Online Learner 
ABCs” is to raise the participants’ awareness of 
theirbackgrounds as L2 learners, of their learning 
habits and processes, and perceptions towards L2 
learning, thus addressing one building block of 


strategy instruction. See Table 3 for the instruc- 
tions given to the participants for each step of 
the project. 


DESIGN OF THE CALL 
ENVIRONMENT 


To implement a user-friendly and flexible Web- 
based environment for the project, we employ the 
Open Source online learning management system 
Moodle, which has been used in our departmental 
section of applied linguistics, foreign language 
research and intercultural communication for 
three years. Our Moodle installation, labeled 
OCCO (Online Course Companion), supplements 
all of our face-to-face classes. Therefore, the 
participants in this study were already familiar 
with the online environment before the beginning 
of the project. 

The “Online Learner ABCs” makes use of the 
following features and activity types available in 
Moodle (see Figure 1). 

Instep A of the ABCs process, the participants 
write and submit their learner autobiography using 
Moodle’s “assignment” learning activity. In step 
B, the learners, who work in self-selected pairs, 
‘jnterview’ each other regarding their life stories 
as L2 learners using text-based chat rooms and 
forums. The participants are asked to go through 
several cycles of online chat sessions (See Figure 
2 for an example) and forum discussions so as to 
allow for both spontaneous, fast-paced interac- 
tion (using the chat room) and more in-depth 
reflection (using the forum). Each student pair 
can only access their own chat room and forum 
in order to facilitate a thorough one-on-one ex- 
change and provide privacy. After finishing the 
interview process, the participants compose a 
learner biography (in the target language) about 
their partner. To conclude step B, Moodle’s ‘wiki’ 
learning activity is used, which allows for peer 
editing and feedback: The participants upload 
the biographies, which are then ‘reviewed’ by 
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Figure 1. The course Web site on the Moodle-based platform “OCCO” 
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Step B: 
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& Your personel ABC's forum Administrator) 
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Figure 2. Step A of the ABCs model: Students interviewing each other in a chat room 
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2 12:24 Anne: actually | liked our book (Greenline)....as far as | can remember 
2 12:24 Anne: | liked the characters inside the stories, maybe | identified with them? 


2 12:24 Tina: the normal book was definitely better than the workbook 


12:25 Tina: Yes that's true the stories were quite nice sometimes. With the typical English names and all they 
2 eat is beans on toast and fish and chips (2) 
12:25 Anne: ah, you are right! There was a second book! But again, | liked it......don't ask me why but lama 
fan of tasks where everything seems to be totally clear. 


12:25 Anne: hahahahaha, right! 


12:26 Tina: From the experience that you gained during many years of learning English, would you have liked 
to learn it earlier, maybe already in Kindergarten? 
12:27 Anne: we were supposed to do our homework each day, so we had quite alot to do, in order to have 
more time for friends, we normally did the exercises in the bus all together... 
12:28 Anne: Could have been a big plus | think to have started earlier...especially concerning the total basics 
like "table, chair..." 7 
12:28 Tina: Yes, i agree 

2 12:29 Tina: | saw some children of 3 or 4 years in a documentary on TV and they were not bad and they liked 
it 

2 12:29 Anne: | think these words would have stuck (is this word right?) in my mind forever... 

2 12:29 Anne: | can imagine! For them it is more like a game...we were in a way forced to learn! 


2 12:30 Anne: How were you learning the vocabulary? 


2 12:31 Tina: yes we were forced but didn't we manage it perfectly @ We had those vocabulary units at the 
end of the book and for homework we had to learn them by heart. sometimes we wrote a test afterwards. i 
think we wrote the test once a week 


2 12:32 Anne: My mother was very helpful for me because she liked to ask me all the words 


2 12:32 Anne: we didit in the same way...units...learning by heart....test 
12:32 Tina: in the first years i had to learn vocabulary to make writing and understanding possible at all but 
when you have a certain amounts of words in your mind you don't learn new vocabulray so frequently, | would 
say 
12:33 Anne: totally true....l was so much more diligent concerning to that when | was younger.....shame on 
me! 


2 12:33 Tina: On me too. What did you do to improve your skills in English during school time? Anything special? 


2 12:34 Anne: nowadays | really have to force myself in order to learn new words 


12:35 Anne: later at school | started to learn new words with the help of these little boxes and flash cards (I 
do it until now like this) 
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the partner about whom the biography has been 
written. This way the content of the biographies 
can be validated (Finkbeiner & Koplin, 2002). 
Furthermore, the participants are asked to provide 
feedback to the partner on any language problems 
they notice (peer review). In step C of the ABCs 
process, each student composes a synopsis by 
comparing his or her own learner biography with 
that of his or her partner. Special emphasis is put 
on similarities and differences regarding learning 
strategy use, learning habits, and learner types. 
These synopses are shared in an online forum 
and discussed in the face-to-face class meetings. 
(See also Table 3.) 

By moving the ABCs model to an online 
environment, we allow our students to be time- 
and space-independent when interacting and 
cooperating with their peers. This is especially 
important, since a large proportion of our students 
are commuters, which makes it hard for them to 
meet physically in study groups outside of class. 
Most importantly, chat session transcripts and 
forum discussions leave a ‘permanent trace’ (as 
opposed to oral communication), which can help 
the students reflect more thoroughly on the task at 
hand, both regarding content and language. The 
same holds true for wiki-based collaboration, 
which keeps track of everyone’s ideas and modi- 
fications, thus documenting the learning process 
in a way otherwise impossible or impractical at 
least. This approach also addresses one of the 
shortcomings of previous research on strate- 
gies in CALL environments, namely the lack of 
observation data as the basis for the subsequent 
analysis of the development of strategic compe- 
tence. By utilizing these self-generated corpora 
as ‘permanent traces’ of the learning process we 
also expect the students to develop a higher level 
of metacognition and language awareness. 


RESEARCH QUESTIONS AND 
PROCEDURES 


To examine the development of the students’ 
strategic competence during the “Online Learner 
ABCs,” we focus on the following research ques- 
tions: 


1. _Instep A of the “Online Learner ABCs:” Is 
there any evidence of (a) awareness of and 
(b) reflection on one’s own language learn- 
ing strategy use in the participants’ learner 
autobiographies? 

2. In steps B and C of the “Online Learner 
ABCs:” To what extent do the online “in- 
terviews,” the composition of the learner 
biography about one’s partner, and the 
comparative synopsis trigger additional 
insights into one’s own L2 strategy use—in 
comparison to the autobiography—in terms 
of (a) awareness and (b) reflection, indicat- 
ing the further development of strategic 
competence? 


These research questions warrant a qualitative 
analysis of the data, following the principles and 
procedures of content analysis (Mayring, 2003), 
supplemented by quantifications (i.e., descriptive 
statistics). The data analysis is based on (a) the 
texts written by the students (autobiographies, 
biographies, comparisons), (b) the forum discus- 
sions, (c) the chat session transcripts, and (d) the 
peer editing and feedback during the wiki-based 
activities—all of which are stored on the OCCO 
course Web site. To ascertain the inter-rater 
reliability of the strategy coding procedure, the 
data were coded independently by two graduate 
students who were experts in learning strategy 
research and the ABCs model and who also 
received specific coding guidelines. In a second 
step, the authors of this chapter cooperatively 
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checked and discussed the instances of strategy 
use identified, eliminating those for which agree- 
ment could not be reached. 

In addition to the aforementioned data col- 
lection procedures, an evaluation questionnaire 
asking the participants to provide feedback on the 
perceived usefulness of the project was adminis- 
tered upon completion of the project. 

The research outlined here is descriptive and 
exploratory as it represents the first attempt to 
adapt the original ABCs model to a Learner 
ABCs. Moreover, there is still little experience 
with implementing the ABCs model in a Web- 
based setting (Wilden, 2006, 2007). Hence, our 
goal is to document the participants’ learning 
processes in such a way as to be able to reduce 
the observational data and interpret the results 
(Alassuutari, 1993). Specifically, we extracted 
certain categories from the data (i.e., cognitive, 
metacognitive, and social and affective strategies) 
in order to detect structures or patterns. This 
procedure allows us to have an overall as well as 
detailed look at the development of L2 strategic 
competence in the collaborative online learning 
environment investigated in this study. 


RESULTS AND DISCUSSION 


Is There Any Evidence of 
Awareness of One’s Own Language 
Learning Strategy Use in the 
Participants’ Learner 
Autobiographies? 


We will define awareness of language learning 
strategy use with reference to the three out of 
the five domains used as indicators for language 
awareness by James and Garrett (1991): (a) the 
cognitive domain, (b) the affective domain, and (c) 
the performance domain. Accordingly, awareness 
of language learning strategy use is defined as the 
explicit or implicit knowledge of one’s language 
learning process (including affective factors, such 
as emotions, interests, likes, and dislikes). 
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We used the participants’ explicit or implicit 
knowledge of their specific L2 learning plans, 
actions, behaviors, steps, or techniques as an 
indicator for awareness of their own language 
learning strategy use. Representative examples 
are shown further below. 

As can be seen in Table 4, an average num- 
ber of 5.8 strategies were mentioned or implied 
by the participants in their autobiographies at 
the beginning of the project, indicating a basic 
level of awareness of strategy use in their own 
experiences as a foreign language learner. Given 
the limited length of the autobiographies (200- 
500 words, see Table 3) and also in relation to 
Ma and Kelly’s (2006) findings reported above, 
these findings appear to be well in the range of 
what can be expected from advanced L2 learners, 
especially at the outset of the project. It should be 
noted, however, that the level of strategic aware- 
ness differs considerably among the individual 
participants, as indicated by the minimum and 
maximum values in Table 4. Furthermore, when 
looking at the different strategy categories, the 
students’ awareness of metacognitive strategies 
seems to lag behind that of cognitive and social 
and affective strategies. Against the background 
of previous strategy research, this finding is not 
surprising in that learners are less accustomed 
to verbalizing metacognitive processes, which 
makes them particularly challenging to uncover 
(Finkbeiner, 1998, 2005; Finkbeiner, Knierim, 
Ludwig & Wilden, in press; Finkbeiner, Ludwig, 
Wilden & Knierim, 2006). Finkbeiner (1998) la- 
bels this phenomenon as metacognitive illiteracy: 
“Another challenge for research projects working 
in the field of learning strategies and techniques 
lies in the fact that it is possible that many learn- 
ers have no declarative knowledge whatsoever 
concerning their input of strategies and so can be 
described as ‘metacognitive illiterates’” (Funda- 
mental research questions, paragraph 11). 

The following examples are representative of 
the students’ statements and comments in their 
learner autobiographies resulting from the step 
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Table 4. Participants’ reference to learning strategies in their learner autobiographies 


Strategies referred to 


Category of strategies 


Mean Min. Max. SD 

Cognitive strategies 2.3 0 5 1.6 

Metacognitive strategies 1.4 0 3 0.7 

Social and affective strategies 2,1 0 6 1.7 

Overall 5.8 1 10 2.3 
A in the ABCs process (examples from the data ‘others’ I learned the stuff.” — Metacognitive 


are presented verbatim, including any errors and 
mistakes): 


“IT used to write new words into my vocabulary 
books and then learnt these words writing them 
down on a piece of paper. Every word I did not 
write correctly, I had to write three times again.” 
— Cognitive strategy (repetition) 


“Up to today, I visualize contents whilst learn- 
ing, but not really with pictures —I rather see 
the words in front of my closed eyes” — Cognitive 
strategy (imagery) 


“T was very interested in music and I wanted to 

find out what the text meant. So I took the song- 
books from the CDs and started translating the 
English songs. While hearing the songs again, I 
understood a lot and I could remember a lot of 
unknown vocabulary because I knew what the 
German translation meant.” — Cognitive strategy 
(intertextual transfer, translation, repetition) 


“T found out that at a special time in the afternoon 
Icould keep inmind things best. ” —Metacognitive 
strategy (planning) 


“Another characteristic strategy of mine was 
‘playing the teacher. ’I imagined I was the teacher 
and I had to explain the learning matter to the 
students. I was sitting in my room and talked 
to a fictive class. And while explaining it to the 


strategy (rehearsing, simulation, self-monitoring, 
self-evaluation) 


“During all those years I started to talk to people 
in Englishchatrooms from all over the world which 
helped me a lot to improve my language skills.” 
—Social and affective strategy (seeking opportuni- 
ties for L2 exposure and use) 


“Our parents are not highly educated and do not 
speak any foreign language, so whenever I had a 
problematschool, I asked my older brother to help 
me.” —Social and affective strategy (cooperation, 
questioning for clarification) 


These examples also illustrate the most sig- 
nificant feature of the “Online Learner ABCs,” 
that is, its autobiographic approach, which allows 
the students to delve into their personal learning 
histories as the foundation of their continuing L2 
development. 


Is There Any Evidence of 
Reflection on One’s Own Language 
Learning Strategy Use in the 
Participants’ Learner 
Autobiographies? 


Whenever a student comments on or evaluates 
specific plans, actions, behaviors, steps, or tech- 
niques employedin L2 learning, this is considered 
to represent reflection on his or her language 
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learning strategy use. An inductive analysis 
of the data revealed the particular relevance of 
evaluative statements; thatis, the students voiced, 
for example, the perceived effectiveness of a cer- 
tain learning-related behavior (or lack thereof). 
Furthermore, the students’ comments frequently 
represented an affective response. 

From a quantitative perspective, it is evident 
that most students’ autobiographies included af- 
fective and evaluative statements: On average, 
each student commented nearly eight times (rang- 
ing from zero to 17 times) on his/her previous 
learning experiences in an affective or evaluative 
manner. (The figures for affective and evaluative 
statements are added up for readability reasons.) 
The following quotes from the autobiographies 
illustrate the personal and vivid character of the 
students’ recollections: 


“T have always been a person who liked working 
alone, even yet in those days. I knew well that the 
only person I can rely on was I and that is why I 
never liked teamwork very much. ... Often, I have 
beendisappointed when I relied on fellow students, 
at school as well as at university” (Apprehension 
to cooperation). 


“In secondary school I furthermore learned a lot 
about the English Grammar. All these new rules 
and explanations, which were mostly followed 
by gap texts or other exercises, sometimes really 
confused me. As I always had heard correct English 
I had developed this feeling which enabled me to 
do these exercises without looking at the grammar 
rules.” (Written by a student raised bilingually, 
who had a lot of L2 exposure through his British 
mother) (Attitudes towards formal and functional 
grammar teaching approaches). 


“T already had difficulties in German [i.e., his 
L1] and in the foreign language it got worse. 
I hated English. At the end of fifth grade I only 
just managed to get a four minus [i.e., minimum 
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passing grade]. Due to private lessons 11 I could 
improve to a weak three at the end of class six” 
(Self-fulfilling prophecy of the negative perception 
of the self as a language learner). 


“In my first English lesson ever the teacher came 
into the classroom carrying a huge basket. The first 
thing he took out of the basket was an apple. He 
told us what it was called in English. He went on 
picking several things out of the basket. We had to 
repeat the English words. I enjoyed it very much 
because I found it very easy.” (Positive attitude 
towards action-oriented teaching). 


“When I arrived in Mexico I could hardly say 
a word in Spanish. Understanding what people 
were saying was almost impossible for me. But, 
after three to four months I was able to use the 
Spanish language quite fluently. But this happened 
from one day to the other. There was no process 
I recognized. I remember being frustrated all the 
time, and than suddenly it changed.” (Feelings 
perceived during the transition from formal in- 
struction to immersion) 


“We used several colored cards in school, on 
which things like a cat, a clock or something to 
eat was shown and we learned how to read and 
how to write the words. This was fun; because my 
whole class was proud of the new words we could 
read and write” (Positive attitude towards holistic 
learning, using word-picture combinations). 


“My father’s loveliest hobby is listening to music. 
So, my sister and I got to know the Beatles, Abba 
and the Rolling Stones when we were very young. 
Even in the kindergarten I started to hear and to 
sing songs like ‘Satisfaction’ or ‘Take a chance 
on me.’ As a matter of course the text I sang was 
completely wrong, but it was a wonderful feeling 
to realize what they really do sing in there songs 
when I entered the fifth class. Therefore learning 
Englishnot only meantto learna foreign language 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Developing L2 Strategic Competence Online 


but also to learn what the bands tell the world 
with their songs” (Prior experience with authentic 
texts and impact on L2 learning). 


These examples are representative of the broad 
range of experiences which the students were 
willing to share from their individual learning 
histories. Obviously, the personal approach of 
the ABCs model helped the students tap into 
their past learning behaviors and processes as 
valuable starting points for reflection on one’s 
own learning processes. On the other hand, these 
examples also reveal that there is still additional 
potential for further reflection. 

Regarding example (1), the student might want 
to mention what exactly made her disappointed 
during group work, or how precisely she or her 
fellow students (failed to) work together, or what 
she can do in the future to make cooperative 
learning a more satisfying learning experience 
for herself. Regarding example (3), the student 
could have elaborated on what he did during the 
private lessons to improve his grade, forexample, 
by reviewing grammar rules or vocabulary (and 
if so, how exactly he and his private tutor pro- 
ceeded). Regarding example (5), the student might 
want to hypothesize, in retrospect, how her L2 
fluency developed, for it seems logical that this 
did not really happen overnight as indicated in 
the autobiography. Of course, one may argue, it 
is quite challenging to recall details such as these 
especially if the episodes concerned happened 
many years ago. However, even if more specific 


details cannot be accurately remembered, the 
students might be able to discuss with their ABCs 
partner possible explanations or solutions, thus 
initiating more deep-level, metacognitive reflec- 
tion. In other words, a successful exploitation of the 
learner autobiographies hinges upon the students’ 
ability to wonder—that is, to recognize episodes 
in their learning histories which warrant further 
questioning about one’s learning processes and, 
in particular, learning strategies. To what extent 
the chat- and forum-based interviews between 
the ABCs partners, which followed the writing 
of the autobiographies, contributed to triggering 
further reflection of this kind will be explored in 
the following section. 


To What Extent Do the Learner 
Biographies About One’s Partner 
and the Comparative Synopses 
Trigger Additional Awareness of 
Language Learning Strategy Use? 


After composing their autobiographies individu- 
ally (without sharing it with their partner), the 
students ‘interviewed’ their partners using a chat 
room and forum, which were kept separate for each 
ABCs tandem, to write a learner biography about 
the respective partner. At this stage of the ABCs 
Model, it is critical that the students go beyond 
merely retelling their individual autobiographies 
to their partner. Otherwise no additional insights 
into each other’s learning histories (including 
strategy use) would emerge. (Note: Since the 


Table 5. Participants’ reference to learning strategies in the learner biographies about their partners 
(in addition to those mentioned in the autobiographies) 


Strategies referred to 


Category of strategies 


Mean 
Cognitive strategies 1.5 
Metacognitive strategies 1.0 
Social and affective strategies 2.0 
Overall 4.5 


Min. Max. SD 
0 5 1.6 
0 3 1.1 
0 4 1.4 
0 10 2.8 
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biographies were written and peer-edited in 
a wiki, it would be interesting to examine the 
composition process in detail instead of only the 
product, that is, the biography. However, this is 
beyond the scope of this chapter.) 

Table 5 shows that an average number of 
4.5 strategies per student were mentioned in 
the learner biographies which had not been 
mentioned in the autobiographies. This overall 
average frequency as well as the average frequen- 
cies for cognitive and metacognitive strategies 
are somewhat smaller than the corresponding 
frequencies found for the autobiographies; social 
and affective strategies were mentioned approxi- 
mately the same number of times in steps A and 
B of the ABCs model (See Table 4). In sum, the 
process of interviewing one’s ABCs partner still 
triggered the recall of a considerable number of 
episodes from the participants’ learner histories, 
almost doubling the total number of strategies the 
students had become aware of by writing their 
learner autobiographies. This overall picture 
clearly indicates that the participants in this study 
went beyond regurgitating their autobiographies. 
Instead, the interaction with the partner appears 
to have stimulated the recall of additional details 
from their memories as (language) learners in- 
cluding learning strategies. 

Furthermore, the use of chat rooms, forums, 
and wikis may have positively affected the inter- 
viewing process in several ways. Specifically, the 
students were able to use their preferred channel 
of communication: While some opted for the 
more fast-paced and interactive chat room, oth- 
ers appeared to favor the forum, which allowed 
them to be more time-independent and to develop 
their thoughts in a setting that exerts less com- 
municative pressure. Thus, by providing different 
online tools, we were able to cater for different 
learner preferences. When comparing the “Online 
Learner ABCs” with a ‘traditional’ face-to-face 
ABCs (Finkbeiner & Koplin, 2002), the partici- 
pants in the present study had a wider variety of 
options to monitor the ABCs process and harness 
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the available information since the entire com- 
municative process was stored online. Typically, 
ina face-to-face ABCs, quite a bit of information 
tends to get lost because the participants’ ability 
to take exhaustive notes during the interview is 
limited; and even if the interview is recorded on 
tape, the process of viewing or listening to the 
recording tends to be more cumbersome than 
reviewing the log of achat session, forum entries, 
or wiki pages (as in an online ABCs). However, 
based on the present study it is not possible to 
fully ascertain whether these advantages of a 
Web-based ABCs outweigh the lack of face-to- 
face interaction. 

When examining the individual ABCs dyads’ 
progression, it turns out that the interviewing 
phase was not equally effective for all student 
pairs. Specifically, there are seven students who 
uncovered only two or even fewer additional strat- 
egies in comparison to their autobiographies. On 
the other hand, there are eight students who—by 
being interviewed by their partner—became 
aware of a larger number of strategies than by 
writing their autobiographies. Interestingly, four 
of the seven students for who step B was least 
successful, were partners. One of these pairs 
‘complained’ about the ABCs process in a class 
discussion because they had known each other 
extremely well before the beginning of the project 
thus rendering the interview phase—for these 
two students—into an artificial process. (Thus 
this kind of project might be particularly useful 
for e-tandem projects involving students at differ- 
ent locations.) For the remaining less successful 
students no particular explanation can be gleaned 
from the data available. 

In contrastto the learner biographies, the com- 
parative synopses (step C of the “Online Learner 
ABCs”) trigger hardly any additional awareness 
of strategy use. The students generally limited 
themselves to summarizing their findings by 
comparing the autobiographies and biographies 
at the surface level. Almost without exception, 
they focused on checking the biography, which 
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their partners had written about them, for any pos- 
sible misrepresentations or oversights. Moreover, 
they merely named the similarities or differences 
between their partner’s learning history and their 
own; that is, they did not engage in any further 
reflections on the deeper meanings of seemingly 
‘similar’ and ‘different’ episodes or incidents, as 
intended by the detailed instructions for step C 
(see Table 3). The rather superficial conclusion of 
the ABCs process can most likely be attributed to 
the time constraints imposed on the project (final 
exams, deadlines for term papers). 


To What Extent Do the Learner 
Biographies About One’s Partner 
and the Comparative Synopses 
Trigger Additional Reflection on 
Language Learning Strategy Use? 


Whenexamining the biographies for affective and 
evaluative statements, which would be indicative 
of the students’ reflection on their strategy use, 
a striking difference becomes obvious: While 
each autobiography contained almost eight affec- 
tive/evaluative comments, only 2.5 comments of 
this type appeared in the biographies (on aver- 
age, respectively). In other words, the degree of 
reflection—as defined in this study—was much 
lower in the biographies than the autobiographies. 
This may be due to the fact that, apparently, the 
participants tried to write the biographies as 
‘objectively’ as possible, avoiding any personal 
interpretations or judgments. By itself, the lack of 
reflection at this stage of the ABCs process does 
not constitute a significant problem. However, 
when taken together with the limitations of step 
C as described above, it becomes evident that the 
present instructional design does not yet fully 
exploit the anticipated potential for reflection on 
one’s strategy use, at least not at stage C of the 
ABCs process. Ways of amending this shortcom- 
ing will be discussed in the following. 


Student Evaluation 


The following feedback regarding the “Online 
Learner ABCs” was solicited from the project 
participants as part of the course evaluation. 
The students were asked to respond to the fol- 
lowing stimuli: (1) what I really liked, (2) what 
really surprised me, (3) what I would like to learn 
more about, and (4) further comments. The most 
significant findings are captured by the following 
quotes from the students’ responses: 

What the students really liked: “it was a good 
possibility to learn something about one’s learning 
strategies,” “the meta(cognitive) level, to become 
aware about, or to learn about your own steps of 
learning,” “compare with other person,” “youlearn 
more about your partner this ‘connects’ people,” 
the chat session was fun—for me, the first time, 
I did a chat session!” “divided into small steps, 
clear instructions, good online platform.” 

Whatreally surprised the students: “how simi- 
lar our learner biographies seem to be,” “during 
the chat session I really ‘learnt’ much more about 
me in detail,” “I was surprised how easy it was 
to have an interesting, in depth discussion in the 
chatroom,” “myself as a learner.” 

What the students would like to learn more 
about: “more experiences; more documentation; 
more reporting; what others have written about,” 
“can you involve this into a class/do it with stu- 
dents?” (i.e., with high school students), “people 
from another country what would be different? 
Do they use different strategies...?” 

Further comments: “the deadlines for step A 
and B were too hard,” “itis really hard in the ABC 
because it is not possible to ‘meet the partner.” 

The students’ feedback on the “Online Learner 
ABCs” suggests that the principles underlying 
the ABCs process did indeed trigger meaningful 
insights into one’s own as well as the partner’s 
learning behaviors as well as learning strategy use. 
Also, the students appear to have enjoyed using 
the Web-based environment; in particular, they 
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discovered online chatting, which some students 
had never done before, as a valuable tool for mean- 
ingful, educational purposes (and not only for the 
casual chit-chat among friends). On the otherhand, 
the tight schedule for the project was considered 
problematic and probably this had a detrimental 
effect on the depth of the students’ reflections 
in step C. Several students also expressed their 
curiosity with regard to the ABCs model itself 
and its applicability in different contexts (e.g., 
Web-based and face-to-face, in a cross-cultural 
setting, with high school students), which testifies 
to the appeal of the ABCs Model (Finkbeiner, 
2006; Finkbeiner & Knierim, 2006; Finkbeiner 
& Koplin, 2002, Schmidt, 1998; Schmidt & Fink- 
beiner, 2006; Wilden, 2006, 2007). 


Summary of Findings 


Overall, the “Online Learner ABCs” can be con- 
sidered conducive to the students’ development 
of L2 strategic competence. By writing their L2 
learner autobiographies, followed by interview- 
ing a fellow student in order to write a learner 
biography about him or her, the participants 
became aware of a considerable number of lan- 
guage learning strategies. As far as reflection on 
strategy use is concerned, the students frequently 
included evaluative and affective comments in 
their autobiographies. However, the students’ 
learner biographies and comparative synopses 
yielded only a very limited number of reflec- 
tive comments, and the level of reflection was 
lower than in the autobiographies; in part, this 
may be attributed to the project’s tight schedule. 
Yet, this result also corresponds with Wilden’s 
(2007) findings that the ABCs seem to trigger a 
lot more processes connected to the perception 
of the self than of the other (Finkbeiner, 2006, 
pp. 35-39). In sum, steps A and B of the ABCs 
process contributed effectively to raising the stu- 
dents’ awareness of language learning strategies; 
step A was also conducive to initiating students’ 
reflection on strategy use. The design of steps B 
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and C, as implemented in this study, should be 
modified according to the time frame available; 
further suggestions for alternative implementa- 
tions of steps B and C will be presented below. 
Given the exploratory nature of this study, the 
ABCs model appears to be a viable option to fos- 
ter students’ L2 strategic competence deserving 
further instructional fine-tuning and empirical 
investigation. 


FUTURE TRENDS 


Online communication and collaboration ac- 
tivities such as the ones described in the present 
chapter lend themselves very well to exploring 
personal experiences in a collaborative fashion. 
It is extremely useful, both for instructional and 
research purposes, that online course management 
systems (such as Moodle) allow for the conve- 
nient storage and retrieval of student-student and 
student-teacher interaction, providing additional 
opportunities for metacognitive reflection based 
on the ‘permanent traces’ left by forum/chat dis- 
cussions, wiki-based activities, and so on. 

Therefore, future research on L2 strategic 
competence (and other issues) in CALL envi- 
ronments should continue using digitally stored 
observation data, ideally in combination with self- 
report data (student interviews, questionnaires) 
and proficiency or achievement tests (as external 
reference criteria). The investigation of learner 
factors can shed more light on questions such 
as why some students appeared to benefit more 
from the “Online Learner ABCs” in comparison 
to others. A related issue concerns the learners’ 
age (i.e. cognitive and metacognitive maturity) 
and L2 proficiency level if an “Online Learner 
ABCs” is to succeed. Accordingly, it may be 
necessary to use the L1(s) and incorporate more 
teacher guidance. 

Also, since the ABCs process in its present 
form is quite time-consuming, one might consider 
turning step C into a whole-class activity (instead 
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of continuing the pair work, the results of which 
might be too challenging for weaker students to 
communicate effectively to the class); in such a 
scenario, the teacher could also provide more 
guidance in order to trigger deep-level reflections. 
For example, one can focus the students’ aware- 
ness on five most important, striking, surprising, 
interesting, or just thought-provoking words 
both in the autobiography and biography. Once 
the students have filtered out the five words for 
their personal hit list they will be encouraged to 
comment on each single one and reflect on it on 
a deep level, including dimensions such as atti- 
tudes, values, and beliefs (which might originate 
from a cultural script; Finkbeiner, forthcoming). 
On the basis of the hit lists and comments they 
will be encouraged to create a language learner 
profile in a mind map. The mind maps will then 
be exhibited in a learner mind map gallery in 
class (Finkbeiner, 2003). They will be compared 
in order to discover certain patterns, as well as 
similarities and differences. Only after this pro- 
cess has been successfully completed students 
will be asked to compare the two lists extracted 
from the autobiography and biography and start 
process C. 

As the “Online Learner ABCs” appears to 
be suited for raising students’ awareness of L2 
strategies, it may serve as the starting point ina 
series of activities to foster students’ L2 strategic 
competence (see the previous recommendations 
for strategy instruction). 


CONCLUSION 


In recent years, the intersection of CALL and 
language learning strategies has begun to attract 
the CALL community’s attention in orderto better 
understand students’ learning processes in com- 
puter-enhanced language learning environments. 
However, based on research going beyond the 
description of strategy use in CALL applications, 
teachers and materials developers can also explore 


ways of developing learners’ strategic competence 
as such, which will facilitate L2 learning in face- 
to-face as well as technology-enhanced settings. 
As this chapter has illustrated, this endeavor 
does not necessarily require the development 
of complex and expensive software; rather, by 
devising tasks and learning scenarios which 
effectively employ easily available Web-based 
communication and collaboration tools—in this 
case, to become aware of and reflect on learning 
strategy use—teachers can significantly enhance 
their students’ L2 learning experience. The more 
the tasks in an online environment are related 
to the students’ own and authentic L2 learning 
experiences as well as their learner identities, 
the better and more powerful their insights into 
their own L2 learning processes will be. This way 
they will become active agents and win owner- 
ship over their own learning and over their own 
selves. By moving the ABCs model to an online 
environment, we take students seriously as active 
learners as we allow them to be time- and space- 
independent when interacting and cooperating 
with their peers. Furthermore, by using their own 
chat session transcripts and forum discussions as 
a ‘permanent learning trace’ we help them reflect 
more thoroughly on theirlearning process and use 
their self-generated texts as their own language 
learning mirror. 
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KEY TERMS 


The ABCs Model of Intercultural Under- 
standing and Communication (Schmidt, 1998; 
Schmidt & Finkbeiner, 2006): Aims at exploring 
cultural and intercultural differences through a 
three-step process involving two individuals from 
different cultural backgrounds. The three steps 
are: (1) A: writing an autobiography about your- 
self (which is not shared with the partner), (2) B: 
interviewing the partner to write abiography about 
him or her, (3) C: comparing the autobiography of 
oneself with the biography about the partner (and, 
optionally, the partner’s biography about oneself) 
to explore cultural differences and similarities as 
well as self- and other-perception. 


Computer-As-Tutor vs. Computer-As-Tool 
CALL: “With a CALL tutor, acomputer program 
analyzes and evaluates an individual learner’s 
response to a question, and provides feedback 
on it” (Levy & Stockwell, 2006, p. 22) whereas 
“with computer tools the role of the technology 
is best described as an ‘enabling’ device” (Levy 
& Stockwell, 2006, p. 24). 


Intelligent CALL (ICALL): Intelligent 
CALL denotes the use of artificial intelligence in 
the development of CALL materials, for example, 
to create intelligent tutoring systems which are 
capable of processing and giving feedback on 
free language input. 
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Language Learning Strategy: A “specific 
plan, action, behavior, step, or technique that 
individual learners use, with some degree of con- 
sciousness, to improve their progress in developing 
skills in a second or foreign language” (Oxford 
& Schramm, 2007, pp. 47-48). These plans, ac- 
tions, behaviors, and so on, can be placed on three 
continua, ranging from conscious to unconscious, 
from explicit to implicit, and from observable to 
non-observable (Finkbeiner, 1998, 2005). Fur- 
thermore, learning strategies can be categorized 
into major groups, for example, by distinguishing 
cognitive, metacognitive, and social and affective 
strategies (O’Malley & Chamot, 1990). 


LMRplus Model: In the LMRplus model, 
L stands for learner, M for moderator, and R for 
researcher. The model focuses on “cooperation and 
collaboration among the changing roles of teacher 
and learner and researcher” (Finkbeiner, 2004, p. 
114) as well as the different sets of competencies 
that one needs for each of these roles. 


Strategic Competence: Seen as the capacity 
that relates language competence, or knowledge 
of language, to the language user’s knowledge 
structures and the features of the context in which 
communication and language learning takes place. 
Strategic competence performs assessment, plan- 
ning, and execution functions in determining the 
most effective means of achieving a communica- 
tive or language learning goal. It connects de- 
clarative, procedural, and conditional knowledge. 
(adapted from Bachman, 1990, p. 107). 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


403 


Chapter XXIll 
Interventions and Student 
Factors in Collaboration 


Faridah Pawan 
Indiana University, USA 


Senom T. Yalcin 
Indiana University, USA 


Xiaojing Kou 
Indiana University, USA 


ABSTRACT 


This research is an exploratory study of student variables that mediate collaborative engagement in 
online discussions. More directly, the research explores what happens in online discussions when four 
teacher interventions designed to increase collaboration are introduced. The specific aim of the study is 
increasing collaboration that is ‘externally-revealed’ through engagement with others, especially at the 
integration level of Garrison, Anderson and Archer ’s (2001) practical inquiry model. The secondary aim 
of the study is to address the problem of serial monologues in student online discussions and participa- 
tion. The findings yield factors that impact student online collaboration such as student familiarity with 
the subject matter and with the online medium; purpose and timing of online engagement; importance 
of face-saving; and student acceptance of the ‘constructed knower’ role. The research sets the stage for 
future studies of online collaboration from a pedagogical perspective. 


INTRODUCTION AND PURPOSE engagement to be available for immediate and/or 

long-term scrutiny. This research is an explor- 
Computer-mediated communication (CMC) has atory study of student variables that mediate 
now made it possible for student discourse and collaborative engagement in online discussions. 


Copyright © 2008, IGI Global, distributing in print or electronic forms without written permission of IGI Global is prohibited. 
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More directly, the research explores what hap- 
pens in online discussions when selected teacher 
interventions designed to increase collaboration 
are introduced. The present study grows out of 
a prior study conducted in 2003 that focused on 
patterns in online interactions among language 
teachers. 

The increased interest in investigating student 
online collaboration attests not only to the viabil- 
ity that CMC is providing for such research but 
also to an increased interest in CMC pedagogy 
research. Masters and Oberprieler (2004), for 
example, focused on philosophy and content as 
a Means to sustain equitable patterns of student 
online engagement. Pear and Crone-Todd (2002) 
developed a classroom environment whereby ad- 
vanced students collaborated with less advanced 
students in an effort to sustain a socially-based 
learning process in an online classroom. Tuzi 
(2004) put into place a system of e-feedback for 
second language learners to provide input on each 
other’s written compositions. 

The emergence of these types of studies and 
others like them is filling a research void in 
distance education that, until recently, had been 
focusing on the development of courseware and 
repositories of information (See Bonk & Dennen, 
1999). The research reported in this manuscript 
adds to these studies on collaboration and col- 
laborative pedagogy by looking into teaching 
interventions and their impact on student col- 
laboration in discussions. In addition, the study 
also addresses the area of student-related variables 
that mediate collaboration. There is growing 
evidence that many factors extraneous to the 
classroom influence student engagement. For 
example, Herring (2003) has led research on the 
influences of student gender on online discus- 
sions with a focus on participation patterns. In 
addition, Wolfe’s (2000) study yielded research 
data on online participation patterns amongst 
under-performing students and members of ethnic 
minority groups. Yildiz and Bichelmeyer (2003) 
focused on language backgrounds, in particular, 
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English as a second language and its influence on 
the online participation of its speakers. 

These research efforts demonstrate that what 
students bring to the online classroom setting 
influences their participation. Our research con- 
tributes to the investigation of these influences 
in order to enhance collaborative participation 
within the context of teaching interventions that 
were derived from and informed by our previous 
work in 2003. Our current research yields factors 
that impact student collaboration online such as 
student familiarity with the subject matter and 
with the online medium; purpose and timing 
of online engagement; importance of face-sav- 
ing; and student acceptance of the ‘constructed 
knower’ role (Belenky, Clinchy, Goldberger, & 
Tarule, 1986). 


RESEARCH RATIONALE AND 
THEORETICAL FRAMEWORK 


This study supports Garrison, Anderson and 
Archer’s (2001) position that cognitive presence 
and higher levels of critical thinking are enhanced 
when there is collaboration between discussants. 
Collaboration is defined by mutual engagement 
and investment in the sharing of expertise, infor- 
mation, responsibilities, goal and direction-setting 
to achieve understanding or to complete tasks that 
are otherwise unachievable individually (Bruner, 
1991). Engagement in such a process would place 
the discussants in a ‘community of inquiry’ as 
defined by Garrison et al. (2001). 

In 2003, we conducted a study using Garrison 
et al.’s (2001) practical inquiry model to under- 
stand the interaction patterns of students in three 
online classrooms. The phases of engagement in 
the model are described in Table 1. 

The table is adapted from Garrison et al. (2001) 
and was used to code data in the 2003 study dis- 
cussed below that is the precursor to the current 
work reported in this chapter. 

As we utilized the model for our research, 
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Table 1. Phases of the practical inquiry model 


Descriptor Indicators Sociocognitive processes 
Phase 1 Trigger events (Evocative) 
1.1 Recognizing the problem 1.1.1 Presenting background information that 
culminates in a question 
1.2 Sense of puzzlement 1.2.1 Asking questions 
1.2.2 Messages that take discussion in new 
direction 
Phase 2 exploration (Inquisitive) 
2.1 Divergence—within the online 2.1.1 Unsubstantiated contradiction of previous 
Community ideas 
2.2 Information exchange 2.2.1 Personal narratives/descriptions/facts (not 
used as evidence to support a conclusion) 
2.3 Suggestions for consideration 2.3.1 Author explicitly characterizes message as 


exploration; e.g., ‘Does that seem about right? Or 
‘am I way off the mark?’ 


2.4 Brainstorming 2.4.1 Adds to established points but does not 
systematically defend/justify/develop addition 
2.5 Leaps to conclusion 2.5.1 Offers unsupported opinions 
Phase 3 integration (Tentative) 
3.1 Convergence 3.1.1 Reference to previous message followed by 


d 


substantiated agreement; e.g., ‘I agree because... 
3.1.2 Building on, adding to others’ ideas 

3.2 Convergence (Tentative Solutions) 3.2.1 Justified, developed, defensible, yet 
tentative hypotheses 


3.3 Connecting ideas, synthesis 3.3.1 Integrating information from various 
sources—textbook, articles, personal experience 
3.4 Creating solutions 3.4.1 Explicit characterization of message as a 


solution by participant 


Phase 4 Resolution (committed) 

4.1 Vicarious application to real world 
4.2 Testing solutions 

4.3 Defending Solutions 


we realized that there are multiple dimensions in 2003 research effort as well as the one reported 
the practical inquiry model. They consist of (a) in the current manuscript. 
substantiation; (b) collaboration; and (c) inquiry. The 2003 study was undertaken because of a 
All these dimensions take discussants from an specific problem; namely, the prevalence of serial 
individual reflective stage to a stage ofidentifying monologues. The monologues indicated to us that 
and solving problems collectively. Collaboration students were minimally collaborating, if at all. 
becomes a convergence point for all the stages and The 2003 study confirmed our anecdotal observa- 
constitutes the most desired aspect of engagement. tions and yielded results indicating that without 
Consequently, the model fits the objectives of our overt instructor specification and modeling of 
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Table 2. 2003 study results on interaction patterns 


Phase 1 Phase 2 Phase 3 Phase 4 
. . : . ; Off-Task 
Class : sae aan a a 


Literature-based 


Critical Reading 


ise ffs 


Ce 
Ea Ea a 2 CE 1 


Language Teaching 
Total = i 


participation requirements; and without students’ 
self-monitoring of their own participation, stu- 
dents primarily engaged at the exploration level 
of the model. In 2003, we studied three classes 
over two weeks and analyzed the postings of 
55 students. We found that students engaged in 
brainstorming and sharing of personal narratives, 
descriptions and facts 66 percent of the time at the 
exploration phase (See Table 2), with negligible 
attempts to critically defend, justify or develop 
their own position or that of others. 

The results suggested that teacher planning, 
modeling and monitoring of student participa- 
tion are critical in promoting collaboration that 
contributes toward higher levels of critical think- 
ing. In other words, teaching presence (Garrison, 
Anderson & Archer, 2000), is an important ele- 
ment in student collaboration. These results were 
observed in the second part of our analysis in the 
2003 study of the differing teaching dynamics in 
each of the three classes that we studied. 

Thus from the 2003 study, we knew we needed 
to refine online instruction through a teaching 
presence that moves students beyond the explo- 
ration phase to the integration phase where con- 
vergence, connection, and joint solution-building 
are called for. These elements promote learners 

o “think critically, creatively and integratively” 
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(Klemm & Snell cited in Kanuka & Garrison, 
2004) as they think with and collaborate with 
others. We developed three teaching interven- 
tions for this purpose and focused on student 
factors that affected and mediated collaboration 
as per the interventions. The current study takes 
an in-depth look into the all the online postings 
of three students over a span of a whole 14-week 
semester. All names in the study reported in the 
chapter are pseudonyms. 


RESEARCH METHOD AND DESIGN 


The main research questions for the study are 
as follows: 


1. Did specifically-planned teacher interven- 
tions increase student collaboration at the 
integration level? 

2. Giventhe interventions, what are the factors 
that mediate student collaboration at the 
exploration and integration levels? 

3. | What are the implications of the findings 
for effective online collaboration? 


To achieve our objectives, we developed and 
implemented the interventions over 14 weeks: 
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1. Instructor assumption of the trigger role at 
the triggering phase of the practical inquiry 
model. The instructor in this role would set 
the context and the frame for discussions by 
highlighting issues that could potentially be 
of interest in terms of the topics at hand. 
Students were to proceed with the discus- 
sions in accordance to the requirements of 
their assigned roles. 

2. Instructor modeling and allocation of an 
extended period of time (six weeks) to orient 
students with phases in the practical inquiry 
model. 

3. | Developmentand provision of explicit guide- 
lines and expectations for students to assume 
as well as self-select moderator roles; and 
to self-label postings at the various phases 
of the model. 

4. Instructor monitoring of students’ adher- 
ence to the guidelines and expectations and 
periodic interventions when students strayed 
away from them. 


The intervention in which the instructor as- 
sumed the trigger role was included to jump-start 
students’ engagement to the more advanced and 
collaborative phases of the practical inquiry 
model, particularly the integration phase, as 
mentioned earlier in our rationale. It was also 
developed to provide students with a common 
focus for discussions. 

On the basis of the interventions, we studied 
the interaction and collaboration factors of three 
students taking an online class pseudonymously 
identified in this paper as the technology enhanced 
language learning (TELL) class. As mentioned 
earlier, we looked at 146 postings from the three 
students over a period of a semester. Each student 
was expected to postat least 2-3 postings per week. 
We limited the study to three students because 
we wanted the opportunity to take an in-depth 
look at factors that mediate the collaboration of 


individual students. The three students who vol- 
unteered to be in the study were representative 
of the general population who signed up for the 
TELL class. One is a pre-service teacher with 
little experience in both teaching and computer 
use but has familiarity with the online medium; 
the second is an experienced teacher with mini- 
mal experience in technology and no experience 
taking classes online; and finally, an experienced 
teacher and computer user who is familiar with 
the online medium for learning. 


METHODS OF ANALYSIS 


To answer the first research question on the im- 
pact of the interventions, we obtained descriptive 
statistics by coding postings using the same cod- 
ing scheme we used in our 2003 study, that is, in 
accordance to the phases of the practical inquiry 
model (See Table 1) developed by Garrison et al. 
(2001). To answer the second research question 
on student factors that mediate collaboration, 
we undertook a case study approach to analyze 
students’ online postings (146 units) that each 
student submitted throughout the semester. We 
aimed to gain an in-depth understanding, within 
a defined and distinctive context, of the complex 
factors that mediate individual interactions, given 
the teaching interventions. 

The coding procedures were as follows: 
Two coders were hired to code the postings and 
achieved an inter-reliability rate of 83.3 percent. 
Similarly, we used ‘speech segments’ or identified 
here as ‘posting segments’ as units of analysis 
to align them to those we used in the previous 
research. According to Henri and Rigault (1996), 
a speech segment is defined as “the smallest unit 
of delivery linked to a single theme, directed at 
the same addressee (all, individual, subgroup) 
identified by a single type (illocutionary act), 
having a single function (focus)” (p. 62). 
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CLASSROOM DESCRIPTION 


The setting for introducing teacher interventions 
was as follows: The instructor was a fifth-year 
doctoral student whose research focus is on 
computer-enhanced language instruction. She is 
thus familiar with the practical inquiry model. In 
addition, the instructor taught the online course 
five times prior to the research and was not in- 
timidated by the research on her class as she was 
secure of its content and her own instructional 
capabilities. 

Each week, the instructor’s trigger postings 
were at the 1.1 level, that is, whereby using the 
information from the text as reference, she pre- 
sented background and contextual information; 
and identified a problem. The instructor phrased 
her triggering postings in the form of questions as 
away to draw students into classroom discussions 
and to help them find a way to participate in the 
discussions to meet the class’ requirements: 


Hello everyone, 

This week we will be discussing learning styles, 
motivation, intentional cognition, their role in 
learning and where computers might fit in this 
picture. So, what is motivation? How is motiva- 
tion related to learning styles ? What is intentional 
cognition?...What role does motivation play in 
intentional cognition?...Why is technology moti- 
vating to students and not others? 


The remaining interventions were introduced 
in stages in the semester. The firsttwo introductory 
weeks were the social bonding weeks in which 
everyone in the class exchanged personal infor- 
mation, greetings, class requirements and were 
given time to get familiar with the idiosyncrasies 
of asynchronous forum and each other’s ways of 
communicating online. In weeks 3-6, the instruc- 
tor modeled and directed students to undertake 
discussions at the exploration, integration and 
resolution/application phases. From weeks 7-14, 


408 


Interventions and Student Factors in Collaboration 


students either were assigned to be moderators 
or self-selected moderator roles. Throughout the 
second half of the semester, students also were 
asked to label their postings. 


FINDINGS & DISCUSSIONS: 
(PARTS | AND Il) 


We report our findings by means of descriptive 
statistics (Part I) anda case-by-case analysis (Part 
II) of each of the three students’ collaborative 
participation efforts from information obtained 
from the students’ postings and reflective journal 
entries. The statistics provide us with a general 
overview and tracking of the changes that occurred 
in tandem with the interventions we introduced. 
While this information has limited generalization 
due to the small number of students, it provides 
us with anchoring points for the in-depth discus- 
sion and description in the case-by-case analysis 
which follow. 


Descriptive Statistics 


In the current study, we looked at 146 student- 
generated posting segments (See Figure 1). Of the 
146 student posting segments, 61 percent were at 
the exploration phase (exploration postings or EX; 
exploration questions or EQ); 36 percent integra- 
tion phase (integration postings or IN; integration 
questions or IQ); two percent off tasks (OT); and 
one percent were statements at resolution/applica- 
tion stage (AQ). The non-presence of Triggering 
postings or questions is a direct consequence 
of the intervention which was to move students 
quickly beyond the general evocative phases of 
the discussion. 

Our first question for the study was how the 
interventions affected the course of collaborative 
engagements among the three students we studied. 
We were specifically looking for collaborative 
inquiry at the integration phase to be the mainstay 
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Figure 1. Students’ posting types and percentages 


Student Posting Types and Percentages 


of activities. In comparison to our 2003 study, the 
students did demonstrate improvement in terms 
of percentage of postings at the integration phase 
in relation to the total number of postings. Com- 
pared with the previous research (See Table 2), 
the average student integration postings were at 
36 percent as compared to 11 percent in the 2003 
study. The overall exploration postings remained 
relatively constant—61 percent as compared to 
66 percent in 2003 study; however, the off-task 
postings showed significant reduction after inter- 
ventions—2 percent down from 11 percent. The 
application results were not surprising. As was 
mentioned earlier, the limited time in the semes- 
ter and the introductory nature of the course are 
probable factors. In terms of the latter, the course 
required conceptual discussions rather than prob- 
lem solving and direct application. 

We analyzed the descriptive statistics further 
for each of the students and looked at how the 
interventions were yielding specific types of 
postings for each phase of the practical inquiry 


Exploration 


nH integration 
CL] Application 
Off-topic 


model. At the exploration phase, most (38 posting 
segments) were at the brainstorming phase (2.4 
in Table 1). This was followed by 25 information 
exchanges (2.2) and 13 conclusion leaps (2.5); and 
12 suggestions for consideration (2.3). There were 
only two divergences, that is, contradictions to 
previous ideas (2.1). The lack of contradictions 
or divergences is generally reported across the 
board by researchers in the field. At the integra- 
tion phase, most of the posting segments (29) 
were convergences whereby the three students 
made references to other postings, expressed 
and substantiated agreements (3.1). Next were 
10 posting segments that were syntheses (3.3); 
eight tentative solutions (3.2); and five suggested 
solutions (3.4). 

We also looked at the weekly patterns of 
engagement in collaborative inquiry of the three 
students as a whole across the 14 weeks of the 
semester seen in Figure 2, which does not include 
triggering questions as they were none. The week- 
ly patterns also demonstrated how the instructor 
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Figure 2. Students’ weekly postings 
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Students’ Weekly Postings 
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introduced the interventions in accordance to the 
developments she saw in student engagement. 
Figure 2 showed that students were very engaged 
at the beginning of the semester (week 3-6) and 
the end of semester (week 12-14). It also shows 
that students had arelatively substantial number of 
integration postings in weeks when the instructor 
provided modeling (as in week 3-6) and when the 
instructor assigned roles to students (as in week 
7-8 and week 12-14). When students’ integration 
postings faltered during weeks 9-11, thatis during 
weeks they were given roles to choose on their 
own, the instructor began to assign those roles 
again to students in weeks 12-14. As can be seen 
in Figure 2, weeks 9-11 do show a relatively 
lower percentage of integration—15.38 percent 
as compared to 17.65 percent in weeks 1-2; 29.79 
percent in weeks 3-6, 40 percent in weeks 7-8; 
and 60.98 percent in weeks 12-14. 

We need to add a note here on the ‘labeling’ 
intervention as a means to increase students’ 
awareness and ‘mindfulness’ of their postings. 
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The intervention was another attempt to increase 
students’ collaborative postings at the integration 
phase. Students were asked to begin labeling their 
postings in terms of ‘exploration,’ ‘integration’ or 
‘resolution’ in the seventh week. First, we found 
that students did not label consistently but when 
they did so, their labelings were aligned with 
their postings. At this point in our analysis, our 
study suggests that even with interventions that 
are specifically designed to move students to the 
integration phase, overall, the students we studied 
were more comfortable at the exploration phase. 
However, we did see periodic increases in post- 
ings at the integration phase that were aligned 
with the instructor interventions; and we saw 
a significant movement toward the integration 
phase at the end of the semester. What were the 
individual student factors that kept them at the 
exploration phase and the factors that mediated 
their collaboration at the integration phase? These 
factors will be discussed in Part II. 
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Part Il 


Our second set of results from studying the 
students on a case-by-case basis suggested that 
collaborative engagement is mediated by complex 
factors suchas students’ personal and professional 
backgrounds. These variables play a major role 
in not only how our students participated collab- 
oratively at higher levels of discussions but also 
decisions they made about their collaborative par- 
ticipation. Such participation, as mentioned in our 
research rationale, is a multifaceted, interactive 
process that can involve participants in informa- 
tion exchanges; reciprocal feedback; negotiations 
of meanings; as well as movement from private 
and reflective domain of thinking to a public and 
shared forum of engagement (see Curtis & Law- 
son, 2001). The complexity of factors is based on 
individual circumstances, none of which can be 
addressed fully by any intervention. 


Pam 


In analyzing Pam’s postings, several factors 
emerged that shed light on her collaborative 
efforts. At the time of the study, Pam was a pre- 
service language teacher who had no formal 
classroom teaching experience, and had minimal 
background in technology except using it to take 


Table 3. Pam’s postings 


classes online to complete her Master’s inlanguage 
education. She took the TELL class so as to be 
exposed to ways to incorporate technology into 
her teaching in the future. The field of language 
teaching was new to Pam as she had been trained 
to be a flutist and had studied Italian as part of 
her musical training. 

Pam’s lack of experience in teaching and in 
using computers to enhance language teaching, 
found their way into her collaborative engage- 
ment. Of all the three students, Pam had the most 
number of postings (78) (See Table 3). 

67.53 percent of all of Pam’s comments and 
questions were at the exploration level, that is, at 
a level whereby one is engaged in the search for 
clarification. The exploration comments were pri- 
marily at the ‘brainstorming’ level (2.4) whereby 
she added to points made in the discussions but 
did not question the original input nor provide 
justification for the additions she included. Brain- 
storming is an early stage of the critical thinking 
process in which the broadest gamut of ideas is 
generated without judgment or evaluation. In the 
following quote, we see Pam responding in this 
way to Debi’s posting: 


Hi Debi. I have a class [I am taking] that uses 
chatrooms every week at a set time. With Oncourse 
you can also ARCHIVE your chats. So that oth- 


Stages Total of 14 Weeks Percentage 

Trigger 0 0% 

Exploration EX 45 52 58.44% 67.53% 
EQ 7 9.09% 

Integration IN 25 25 32.47% 25.97% 
IQ 0 0% 

Application AP 0 0 6.5% 6.5% 
AQ |0 0% 

Off-Topic it 1.3% 

Total 78 100% 


Key: EX: exploration; EQ: exploration question; IN: integration; IQ: integration question; AP: application; AQ: 


application questions. 
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ers may go and read what was said. All of my 
class’ chats are archived in case a person misses 
a chat one night, they will not miss anything that 
was said. 


Additionally, Pam’s enthusiasm for learning 
something new provided a positive spin to her 
discussions in the classroom; the newness of the 
subject matter kept her more at the explorative 
phase, as well, as can be seen in the following 
excerpt: 


When I first began this class, I did not know much 
about the topic of computer assisted language 
learning. The text and discussions have helped 
me clarify how teachers use computer instruction 
to students in language learning. 


Pam also had the most number of questions 
(seven) of all the three students in the study and 
they were at the exploration phase. Given Pam’s 
limited experiences in teaching and computer 
use in teaching, she was most engaged in ask- 
ing one-way directional questions that sought 
clarification at the exploration phase. Research 
has also shown that novice learners tend to ask 
more questions on easier material (See Miyaki 
& Norman, 1978). 

Pam knew that engagement with others 
would benefit her and add to her knowledge. 
This disposition may have provided a basis for 
her pro-activeness in being a discussant; in the 
frequency of her postings overall and perhaps in 
her initial forays into the integration phase. Pam 
may have seen herself as the beneficiary of the 
engagement in that collaborative discussions with 
others rewarded her and provided her motivation 
to engage with her peers. 

When Pam did move to the integrative phase, 
her experiences also played a role in how she sup- 
ported her assertions. Eighty-five percent of all 
her Integrative postings (18 out of 25) were at the 
3.1 level, that is, at the convergence level of the 
Integrative phase whereby she stated agreement 
and provided a basis for the agreement. 
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Pam’s move into the integrative phase was 
neither comfortable nor easy. Part of the Pam’s 
discomfort about being an integrator in weeks 7 
and 8 can again be attributed to her novice status 
and her need for more information in the area of 
computer use in teaching languages as demon- 
strated in her quote from the discussions at the 
end of the week: 


I am not sure that I can really integrate ap- 
propriately here with this section [on learning 
styles]. Iam not very good at that. Besides more 
discussion needs to be done before we can really 
say this is the best way for learning or teaching. 
I have really thought about many things that we 
have all discussed with our individual classrooms 
experiences and everyone ’s different perspective 
on the readings. 


Nevertheless, Pam posted three Integrative 
postings during weeks 7 and 8 when she was as- 
signed as the integrator. During weeks 12-14, she 
posted 14, either because she had more time or 
more experience with such postings. Itneeds tobe 
mentioned here that the interventions, in terms of 
the role assignments and self-labeling of postings, 
did put acrimp on Pam’s enthusiasm for participa- 
tion. In one of her bi-weekly reflections (In week 
7/8), Pam expressed disappointment in not being 
able to engage fully in discussions because of the 
role assignment intervention. Nevertheless, Pam’s 
collaborative efforts demonstrated an eagerness 
to understand; to learn from others; and to seek 
outcomes meaningful to her knowledge of com- 
puters and teaching. 


Debi 


Debi’s participation patterns demonstrated that 
collaborative engagement is mediated by student 
familiarity with the online medium and timing of 
engagement. Debi’s participation also raises the 
issue as to whether active engagement in seeking 
connections with the thoughts of others meets the 
requirements of collaborative inquiry. 
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Debi is aninternational graduate student. At the 
time of the study, hermajor was in an international 
language that she was teaching to undergraduates 
at her university. She shares with Pam an excite- 
ment for teaching and a passion in music. 

The TELL class was Debi’s first introduction to 
online learning and classroom environment. She 
struggled to adjust her learning styles and work 
habits to the new medium and had the following 
to say in her reflections in week 3: 


I was still in a stage of getting used to this new 
learning means. It is exciting. But frankly, since 
it is not like other classes, in which students get 
together regularly every week, I have not set up 
a habit to do this coursework regularly, so was 
often overwhelmed by other course work. That is 
why I didn’t attend the second week’s discussion. 
I apologize for it. Now I am adjusting [to] it, 
and I will participate more actively in the class 
discussion from now on. 


Debi was not immediately aware of the en- 
gagement norms and the time management skills 


Figure 3. Debi’s posting patterns 


needed in the online medium. She was more used 
to the structured time format and the immediacy of 
engagement afforded by face-to-face classrooms. 
Consequently, the ‘pressure of regular engage- 
ment’ in the TELL class was easily ignored as 
there was no required time to attend the online 
class. She might also have assumed that online 
and onsite class interactive expectations were 
similar and thus needed the extra time to adjust 
when she found them to be different. However, it 
is clear that Debi’s unfamiliarity with the norms of 
medium, even after two weeks of the instructor’s 
intensive effort to familiarize students with the 
medium, affected the regularity and frequency of 
Debi’s engagement at exploration and integrative 
phases of discussions in the initial weeks. 

Debi, however, made bold moves into the 
integration phase during weeks 3-6 (nine post- 
ing segments) and again in weeks 12-14 (eight 
posting segments) while there is only one such 
posting in week 7 and none in other weeks (See 
Figure 3). These were time periods during which 
the instructor assigned Debi to be one of the 
moderators. 


Debbie's Posting Patterns 
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This role assignment no doubt was a catalyst 
that helped her to feel more involved and engaged 
as was apparent from her reflections: 


It was avery good experience for me as a facilitator 
during the passing week. I felt I was so involved 
in the discussion that everyday I checked mes- 
sages on the asynchronous forum and felt eager 
to respond to them. 


Despite Debi’s low number of postings (28 
compared to 78 and 40 for Pam and Jason re- 
spectively; See Table 4), those two bursts of 
Integrative postings resulted in Debi having the 
highest percentage of integration messages at 
66.67 percent compared to 25.97 percent (Pam) 
and 22.5 percent (Jason). 

The overall low number of Debi’s postings, 
Duffy, Dueber and Hawley (1998) would argue, 
does not necessarily mean that there was no 
engagement or learning. What concerns us was 
whether or not the low numbers suggest ineffec- 
tive engagement in collaboration marked by a 
lack of interactive and back and forth explana- 
tion, questioning, investigation and negotiation. 
The high percentage of integration levels seem to 
suggest that Debi focused her efforts at the more 


Table 4. Debi’s postings 
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advanced phase of thinking and inquiry achieved 
through negotiation and collaboration with others. 
A closer examination of Debi’s participation pat- 
terns reveals that she had a balance of integration 
postings thatreferred to and substantiated previous 
postings by classmates and synthesis postings that 
summarized and pulled together previous postings 
and information. She had four posting segments 
at level 3.1 and eight at level 3.2 and six at level 
3.3. However, the lateness of Debi’s participation 
kept her from timely construction of knowledge 
with others and she was often left with the option 
of adding on to the thoughts of others at the end 
of the week without the benefit of engagement 
in the ‘explain and challenge cycles’ (Curtis & 
Lawson, 2001). 

In between weeks 8-10, Debi’s participation 
nose-dived (see Figure 3). In her fourth reflections 
that she posted in week 11, Debi lamented her 
inability to participate and engage more actively 
during that period and blamed difficulty manag- 
ing a balance between the online class and onsite 
classes she was taking and teaching. Given her 
circumstances, Debi resorted to a very limited 
engagement at the exploration level in week 11 
with one posting. Debi shared her thoughts but 
did not integrate or engage in interactive question- 


Stages Total of 14 Weeks Percentage 

Trigger 0 0% 

Exploration EX 7 9 25.93% 33.34% 
EQ 2 7.41% 

Integration IN 12 15 55.56% 66.67% 
IQ 3 11.11% 

Application AP 0 0 0% 0% 
AQ |0 0% 

Off-Topic 1 3.70% 

Total 28 100% 


Key: EX: exploration; EQ: exploration question; IN: integration; IQ: integration question; AP: application; AQ: 


application questions. 
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ing or investigation with others in a collaborative 
manner. 

Mentzell (1994) states that knowledge con- 
struction through collaboration takes time. In 
Debi’s case, when time was limited, she focused 
on sharing information about her own circum- 
stances at the exploration phase. It is a solipsistic 
mode of engagement that is made easier by the 
online medium. 

Finally, Debi’s questions also caught our 
attention. We noticed that her questions were 
primarily rhetorical and were followed with her 
own responses to the questions. This posting il- 
lustrates the case: 


Who would a person be for you to talk to, to use 
the language, to really (genuinely) communicate 
meaning ? I am not really sure... Does this mean 
that [the professor’s] language isn’t being com- 
municated ? [The professor ’s] “audience” would 
or would not be “authentic” then?... It should not 
matter... as long as the vehicle of communication 
is common between the parties that are attempting 
to communicate. Right?! 


Debi might have realized that few would re- 
spond to her input because of the input’s frequent 
lateness. In addition, she might have been overtly 
avoiding conflict as Blanchette (2001) points out 
in terms of the frequent presence of rhetorical 
questions in online discussions. Similar to Jason, 
as will be discussed in the next section, Debi 
might be looking for a more consensual means 
to construct knowledge with others. 


Jason 


Similarto Pam, Jason’s collaborative engagement 
in discussions was defined by individual experi- 
ences and background. Pam and Jason differ, 
however, in the types of experiences and how the 
latter affect the ways they engage with each other 
and with others in discussions. Jason’s engage- 
ment patterns in relation to the interventions also 


brought forth students’ individual purposes and 
comfort level in engaging in collaboration and 
evolution as effective collaborators. 

Jason became a teacher and a school admin- 
istrator after a successful initial career in the 
financial world. He speaks three languages; and 
uses computers extensively in his private life and 
in teaching. At the time of the study, besides be- 
ing the chair of a department in his school and a 
college counselor, Jason was a special education 
teacher. 

Jason’s confidence in his own computer skills; 
his past successful experience in the result-driven 
corporate world; his senior status in the teaching 
profession; and his unique area of expertise con- 
tributed to his individuality inthe class. Moreover, 
teaching in aspecial education program made him 
feel like an outsider while he was in the TELL 
class whose members were primarily interested 
in second and/or foreign language teaching: 


As I progress through the course, I continue to 
find myself in a weird place as I am not teach- 
ing a foreign language; rather, I am teaching a 
native language to people who have a difficult 
time understanding it. So if you can call ESL a 
traditional class setting, I certainly don’t fall in 
that traditional setting. 


All these factors, in addition, might have 
contributed to his focus on the instructor as the 
authority figure and the main interested audience 
to his postings. We noticed that in weeks 1-2, Jason 
primarily responded to the instructor’s questions 
except in one instance. In weeks 3 through 6, 
Jason continued to post without referencing the 
contributions of others. 

Upon checking his postings for those few 
weeks, we also uncovered another possible ex- 
planation for Jason’s non-collaborative postings 
in the first half of the semester: 


As someone who tends to resist group work, I 
think that computers offer me anonymity, and 
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I am probably more likely to make a comment 
in an atmosphere when I could not be openly 
ridiculed. 


Besides an aversion to group work, Jason was 
also protecting himself from tension and conflict 
in discussions that would have emerged if he 
asked others to justify their position and if asked 
to do so himself in return. Herring (2003) would 
add that male engagement patterns demonstrate 
a movement away from self-revelations and per- 
sonally or professionally vulnerable postings. 
Nevertheless, Jason’s reflection is challenging 
the view of “social constructionists who suggest 
that collaborative activity should center around 
conflict” (Mentzell, 1994). Jason, at this point, did 
not feel safe or comfortable with putting himself 
in a situation where his views and efforts would 
be challenged and thus avoided collaborative 
discussions. 

In addition, as an experienced teacher, Jason 
might have been used to the individualistic mode 
of operation that has been reported as more a 
norm than an exception in the teaching profession. 
Also, Freeman and Johnson (1998) point out that 
one of the first priorities of experienced teachers, 
such as Jason, in taking professional development 
classes, is to understand their own practice and 
to find opportunities where they can share the 
practice so that it can be validated. Their position 
thus puts another spin on Jason’s postings such as 
the one below at the exploration phase: 


I would like to comment on 2 points. First, about 
the role of teacher as authentic audience. When I 
learned Russian, the teacher was the only person 
(besides the few classmates I had) who COULD 
act as any audience...When I lived and traveled 
abroad, I found two things very interesting. First, 
Americans will tell people they “know” a language 
even if they only have a few years of it, but they 
are not likely to use it. The foreigners I have met 
will say they do not know English, but then speak 
to me in relatively good English (and be excited 
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to use it!) I am always excited to use a language 
because I find it difficult to have an authentic 
audience, so I think in some cases the teacher 
must play the role of authentic audience. 


Jason was tracing the sources of influence on 
his practice. Perhaps he saw the class as opportu- 
nity to make transparent to himself his approach 
to teaching. 

Jason’s participation patterns began to show 
slight differences upon the implementations of 
additional interventions in the second half of the 
semester (weeks 7-14), including explicit assign- 
ment of roles; student self-selection of roles and 
labeling of postings. In this part of the semester, 
he included seven integration postings, compared 
to only two in the first part of the semester. More 
importantly, Jason was demonstrating an aware- 
ness of his community of collaborators, including 
his membership and responsibility in it. The fol- 
lowing quotes are illustrative and are from weeks 
7-8, when Jason was assigned moderator roles: 


I agree with Linda that Karen’s statement about 
technology being able to motivate every child. I 
think that multimedia devices make learning the 
information more interesting, and perhaps the 
computer can better target the child’s pathways, 
but placing a computer in front of a child is not 
enough. Linda is right that it needs to be a com- 
bined effort with the teacher and computer, but 
even still there are students you will not be able 
to engage. 


In this quote, which is at the integration phase, 
Jason synthesized and built upon points made by 
others while the quote below from his reflection 
that accompanied weeks 7 and 8 discussions, 
signals Jason’s awareness of himself as a critical 
member of the inquiry community who can con- 
tribute to the joint construction of knowledge. 

Jason stayed on course by moving out of his 
private world into the shared world of collabora- 
tive engagement in week 9, when he selected his 
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own moderating role. Jason was also notable in 
that he was the only one of the three students who 
attempted to post at the application level toward 
the final weeks, without instructor modeling or 
direction (See Table 5). 

His attempt can be explained partly by the 
focus of discussion on the future of technology, a 
topic with which he has much familiarity through 
previous experience. For others to collaboratively 
participate in the application phase with Jason, 
they would have had to share with him similar 
prolonged experiences and common knowledge 
in technology. 

Jason’s evolution as a member of the collab- 
orative community of inquiry in his class was 
clearly impacted by the instructor intervention, 
mediated by his growing sense of responsibility 
as amember of inquiry. Both factors played arole 
in Jason’s shift from the private/internal phase 
to one of shared experiences and engagement 
where he made room for and sought the thoughts 
of others. 


CONCLUSIONS AND IMPLICATIONS 


This research is an exploratory study of the poten- 
tial factors that mediate collaborative engagement 


Table 5. Jason’s postings 


of students in online discussions. For that purpose, 
the three researchers in the study introduced, in 
a progressively direct manner, teaching interven- 
tions directed at increasing student collaboration 
at the integration phase of the practical inquiry 
model. The interventions did not yield an overall 
increase at the integration phase. Inthatregard, the 
overall results of the study are in agreement with 
that of other research in CMC, in that exploration 
is the phase that student discussions seem to center 
around (See Angeli, Valanides, & Bonk, 2003). 
However, as was mentioned previously, we did 
see periodic increases in postings at the integra- 
tion phase that were aligned with the instructor 
interventions; we saw a significant movement 
toward the integration phase at the end of the 
semester; and our students did stay on task with 
negligible off-task postings in comparison to the 
approximately 30 percent often reported in other 
studies that utilize the practical inquiry model as 
a coding scheme. In addition, the study, yielded 
variables that could be used to conduct research 
on student factors that affect collaboration on 
online discussions. The factors include student 
familiarity with the subject matter; familiarity 
with the online medium, timing of engagement 
online; purpose for engagement; importance of 
face-saving; and willingness to accept responsi- 


Stages Total of 14 Weeks Percentage 

Trigger 0 0% 

Exploration EX 28 29 67.5% 72.5% 
EQ 2 5.0% 

Integration IN 9 10 22.5% 25.0% 
IQ ik 2.5% 

Application AP 1 il 2.5% 2.5% 
AQ |0 0% 

Off-Topic 1 2.5% 

Total 40 100% 


Key: EX: exploration; EQ: exploration question; IN: integration; IQ: integration question; AP: application; AQ: 


application questions. 


417 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


bility as a constructed knower in a community 
of inquiry. 

Our position at this point is that CMC provides 
a natural avenue for critical thinking through 
collaboration especially because of the delibera- 
tive and reflective setting that is made possible 
by the textual mode within an asynchronous and 
self-paced forum. However, several factors, such 
as the ones raised by the study, require resolution 
before collaborative engagement can be effectively 
manifested online. 


LIMITATIONS AND FUTURE 
DIRECTIONS 


The study was targeted at increasing collabo- 
ration that is ‘externally-revealed’ (Kanuka & 
Anderson, 2004) through engagement with 
others, especially at the integration level of the 
practical inquiry model. Garrison et al. (2001) 
would argue, however, that part of a shared con- 
ception collaboratively developed, may either be 
published (public); or it may be more reflective 
and personal, as semi private. Duffy et al. (1998) 
would also add that learning can also take place 
without students being ‘quick and bold on their 
feet’ to engage collaboratively and that students 
donot necessarily equally engage in collaboration. 
Such arguments render it acceptable to tolerate 
the infrequent participation and collaboration by 
online students such Debi as long as they report 
gains in their learning which all three students 
did in their final reflections. 

Generalization of results from this study is 
limited in that we looked at the collaborative 
engagement of only three students over a one- 
semester period. We also only used two sets 
of data, namely the students’ postings and the 
bi-weekly journal entries that accompanied stu- 
dent postings. Moreover, we only focused on one 
instructor’s implementation of the interventions; 
more information would have been obtained had 
we worked with other instructors and compared 
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results. Additionally, we left it to the one instruc- 
tor to make ‘on-the-ground’ or practitioner-based 
instructional decisions as to how to incorporate 
the interventions in ways that she saw appropriate 
to the class. However, we did direct the instruc- 
tor to use four weeks to model the interventions. 
More marked changes might have been observed 
if the interventions had been put in place earlier 
in the semester. 

Nevertheless, our approach to the research 
points to the need for future studies on the imple- 
mentation process of pedagogical interventions. 
Most studies focus on either designing an imple- 
mentation process or analyzing the results of the 
implementation. Such a study could utilize the 
instructor postings and reflections throughout the 
course that could yield information on the critical 
inquirer role she assumed; the student cues she 
found significant in introducing the interventions 
in class throughout the semester; reservations 
about the interventions and modifications she 
made so that they are more aligned to her teach- 
ing philosophy and practice. In other words, our 
approach in the study sets the stage for the study 
of collaboration from an instructor’s reflective 
perspective. 
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KEY TERMS 


Constructed Knowers: Belenky et al.’s (1986) 
conception of individuals who are committed to 
the empowerment and improvement in the quality 
of life and knowledge of others. 


Face-Saving: A need to project an image of 
strength and knowledge. 


Online Collaboration: Students referencing, 
building upon, challenging, integrating, testing, 
using etc. ideas of fellow discussants in an online 
discussion forum. 


Practical Inquiry Model: Garrison et al.’s 
(2001) theoretical framework that defines the 
outcomes of collaboration in a higher education 
online course environment through four phases 
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of critical thinking and cognitive presence, that 
is triggering, exploration, integration and resolu- 
tion. 


Serial Monologues: Discussions in which 
online participants freely share experiences and 
express opinions with minimal effort made to 
connect to the contributions of others. 


Teaching Interventions: Modifications made 
to instruction to prompt students to make changes 
and/or to take a new approach to classroom par- 
ticipation. 


Teaching Presence: Three critical functions 
defined by Anderson, Rourke, Garrison, and 
Archer (2001) of the online teacher, namely, de- 
signing and administrating learning activities, 
establishing and maintaining an active learning 
community, and providing direct instruction. 
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Section IV 
The Use of Corpora in Language 
Acquisition and Learning 


The three papers contained in this section discuss the complexity of using corpora in language learn- 
ing especially in learner-centered approaches. However, the conclusion reached by all three papers is 
that it is a cooperative enterprise between teachers and students in order to maximize the potential of 
corpora in language acquisition. 
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Chapter XXIV 
Corpora in the Classroom 
and Beyond 


Rolf Kreyer 
University of Bonn, Germany 


ABSTRACT 


Although corpus linguistic methods and research have had a considerable impact on language teaching 
in the last few decades, the corpus is still mostly regarded as a device in the hands of the teacher rather 
than the students. This is most probably due to a number of serious problems that need to be considered 
when allowing students unlimited access to the wealth of corpus-linguistic data. In this chapter it is 
argued that these problems are to be taken seriously and that a fundamental prerequisite for student use 
of corpora is what I call ‘corpus competence.’ Such a corpus competence will not only help students 
to make use of corpora in the classroom but will also prepare the grounds for use of corpora in non- 
institutionalized contexts and as a tool for life-long learning. 


INTRODUCTION 


In the early 60s, with the compilation of the 
BROWN corpus, modern corpus linguistics made 
its way into the field of linguistics and since then 
has been a firmly established methodology and 
discipline. The study of large amounts of authentic 
language data has led to new insights into the 
use of language and into our conception of the 
language system. These insights have also had a 
strong impact on language teaching. A number 


of articles, for instance, describe discrepancies 
between the language that is represented in text 
books and the language use that is attested in 
corpora: cases in point are the use of some and 
any in affirmative and negative contexts (Tesch, 
1988), the use of relative pronouns in restrictive 
relative clauses (Kreyer, 2000), or the use of 
tense and aspect in conditional sentences (R6mer, 
2004a; Schapers, 2005), to name but a few (for 
other areas of discrepancy consider Grabowski & 
Mindt, 1995; Romer, 2004b). Corpus-based find- 
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ings have also made their way into many textbooks 
and dictionaries: The German school grammar 
Englische Grammatik Heute (Ungerer, 1999), for 
instance, emphasizes the fact that its descriptions 
of language use are (to some extent) corpus based 
(cf. Mukherjee, 2004) and the Collins Cobuild 
English Dictionary aims at ‘helping learners with 
real English,’ that is, through authentic language 
data drawn from corpora. This shows that corpus 
linguistics is extremely influential with regard 
to linguistics in general and also with regard to 
language teaching, especially curriculum design 
and reference tools (see also Meunier, 2002). 

The more recent past has seen attempts to 
make corpus-linguistic methods more directly 
applicable to language teaching. In this respect, 
two different kinds of suggestions are usually 
made: (1) the corpus as a tool in the hands of 
the teacher to prepare materials or as an aid in 
marking students’ writings, or (2) the corpus as a 
tool in the hands of the students, that is, students 
are encouraged to induce rules and regularities 
into the data that the corpus provides. Although 
the number of teachers that actually use corpora 
along the lines of (1) is still fairly small, recent 
studies indicate a trend towards an increasing use 
of corpora or corpus-based findings by teachers 
(see, for instance, Tsui, 2004, 2005). On the other 
hand, there still is “a need to convince practicing 
teachers to use corpora and concordances in the 
classroom” (Rémer, 2006); teachers seem to be 
reluctant to give their students immediate access 
to corpora (Mukherjee, 2004), although there 
are many suggestions about how to ‘do corpus 
linguistics’ in the classroom (see Kreyer, 2007; 
Mukherjee, 2002; Rautenhaus, 1996; Tribble & 
Jones, 1997). 

This reluctance is not unfounded. If students 
are confronted with raw corpus data a number 
of severe problems arise, all of which have to be 
taken seriously. Doing corpus linguistics is a skill 
that has to be and, fortunately, can be, trained (see 
Kirk, 2002; Bernardini, 2002 for some sugges- 
tions). Students need to be taught how to make 


use of the corpus, and they need to be made aware 
of its restrictions and shortcomings as well as its 
potential and advantages. In short, students need 
to be taught a set of skills that will allow them to 
exploit corpora on their own without the help of 
the teacher. Such a set of skills has been sketched 
out by Mukherjee (2002, pp. 179-180) under the 
term ‘corpus literacy’. In this chapter, I discuss 
each of these skills in detail, explore additional 
aspects and, finally, investigate the interdepen- 
dencies between all of the relevant aspects. This 
extension of Mukherjee’s concept I will refer to 
as “corpus competence’. 

Since to a large extent corpus competence 
means knowledge of how to deal with problematic 
aspects in working with corpora, I first give an 
overview of these problems. Then, I portray some 
of the benefits of language learning with the help of 
corpora. The remaining chapter describes aspects 
of corpus competence and makes suggestions as to 
how these can be taught at school or university. It 
is argued that corpus competence is indispensable 
if students want to work with raw corpus data and 
that through corpus competence the corpus can 
become a learning aid in non-institutionalized 
contexts and a tool for life-long learning. 


PROBLEMS WITH INTERPRETING 
RAW CORPUS DATA 


Working with a corpus is a very demanding ac- 
tivity for the researcher as well as the student of 
a foreign language. Most importantly, it is often 
far from trivial to interpret authentic corpus data. 
As Mauranen (2004) points out: 


Noticing things in corpus data is an acquired skill 
even for linguistically relatively sophisticated 
learners like L2 majors in university depart- 
ments [...]. Less sophisticated students need even 
more tuition in making observations from corpus 
material. Initially, even making sense of a set of 
pre-edited concordance lines tends to be hard 
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for many learners, although it soon becomes an 
easy routine. Amuch more demanding task is to 
make meaningful observations on unedited (i.e., 
unselected) concordances independently, and 
the hardest of all is learning to ask appropriate 
questions of the corpus (p. 99). 


In line with this quote, the present section 
discusses some of the problems that students are 
facing when confronted with raw corpus data. 
A particular focus is on (1) getting the relevant 
data from a corpus; (2) the influence of language 
varieties and genres; and (3) the interpretation of 
frequencies. I am aware of the fact that this list 
is far from conclusive. To me, however, these 
problems seem to be the most relevant and I 
regard them as being central to the concept of 
corpus competence that will be discussed later 
on. Each of the three problems will be discussed 
in the following. 


The Problem of Getting the Relevant 
Data 


It seems to be fairly undisputed among for- 
eign-language teachers, textbook authors and 
dictionary compilers that one of the strengths of 
corpus linguistic approaches to language teach- 
ing is the wealth of authentic data that students 
are confronted with. This wealth, however, may 
make the corpus very difficult to work with for 
inexperienced as well as experienced students. 
The problem resides in the fact that usually 
the teacher (and the student) has a particular use 
of an individual lexical item or construction in 
mind while the corpus yields a large variety of 
different instances of use. Although it may be easy 
for the teacher to identify the relevant items, the 
different instances might easily overwhelm the 
less experienced learner. Imagine, for instance, 
students are asked to ‘find’ the use of perfect as- 
pect with ‘since’ as a preposition or conjunction 
in raw corpus data. An obvious first step would 
be to search a corpus for all occurrences of since 
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and analyze the concordance lines. The following 
examples, providing 10 random instances of the 
word in the British National Corpus, indicate that 
students may encounter great difficulties: 


1. The AC contact wasn’t Shelby’s first; he’d 
been hawking his sports car plans around 
since the late 50s and among the people he’d 
contacted with a view to building his hybrid 
had been his good friend Donald Healey 
(BNC: A6W_1038). 

2. Since we had no home of our own, any of- 
ficial communication would go to Leslie’s 
mother’s address (BNC: AMC_1333). 

3. Many hundreds of casts of these human 
fossils have since been made, and from 
them we can learn a good deal about the 
last appalling hours in the life of Pompeii 
(BNC: ASR_347). 

4. But, since then the evidence against oscilla- 
tions has been mounting (BNC: B71_782). 

5. The development of occupational pension 
schemes, and the rapid increase of owner- 
occupation since the 1950s, has given many 
elderly people far more economic security in 
old age than they ever had when they were 
reliant on the sale of their labour power 
(BNC: CKP_861). 

6. Painstakingly, with meticulous attention 
to detail, Tethlis rebuilt the Elf forces to a 
strength not seen since the time of Aenarion 
(BNC: CM1_1051). 

7. Since incremental kWh charges were also 
increased only in step with the bulk running 
charge, the Boards were in effect making no 
charge for any additional capacity necessary 
to meet the increased domestic sales over 
that ten-year period (BNC: CRD_986). 

8. This applies both to the origins of sociology 
and to the characteristics of its practitioners 
since the beginning (BNC: EBR_364). 

9. Thus, since relative incidence (new cases 
of known opioid use) reached 356 during 
1985 - 6, this suggests that prevalence had 
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increased by a further 95 individuals (BNC: 
EDC_439). 

10. Idress myself untidily, my family despair of 
me, and I have absolutely no sympathy with 
any technological advance since the inven- 
tion of the shoehorn (BNC: FB9_2617). 


Of the 10 examples provided, only tokens 
(1) and (4) might be immediately helpful to the 
learner. Example (3) is also a relevant instance 
but it needs experience to find that since, here, is 
understood as since then, with then most probably 
referring anaphorically to a particular point in 
time mentioned in one of the previous sentences. 
Similarly, in (6) a relative clause would bring 
out the expected pattern (Tehthlis rebuilt the Elf 
forces to a strength that had not been seen since 
the time of Aenarion), but the post-modifying past 
participle clause does not. Three tokens, namely 
(2), (7), and (9) show the use of since as a causal 
conjunction, and in examples (5) and (10) since 
merely introduces a post-modifying prepositional 
phrase. To make things even worse, (8) appears 
to be a counterexample: the since phrase clearly 
denotes a point in time in the past, but the verb 
is in simple present tense. Whether we are deal- 
ing with a genuine counterexample, of course, 
depends on the functional analysis of the since 
phrase (i.e., sentence adverbial as opposed to 
postmodification of a noun phrase head); in any 
case, example (8) will be highly problematic for 
students. Obviously, on the basis of this data, 
students will have difficulties ‘finding’ the use 
of perfect aspect after since as described in 
dictionaries such as the Longman Dictionary of 
Contemporary English (2003): 


Use since to say that something started at a point 
in time in the past, and is still continuing: He has 
been living in Leeds since 1998. | We’ve known 
about it since May. 


Since is usually followed by a time expression 
(‘last year,’ ‘this morning,’ ‘4 o’clock’ etc) or by 


the simple past tense. Use the present perfect or 
the past perfect in the other clause: I have loved 
movies since I first went to the cinema. | He had 
been seriously ill since Christmas (1539). 


What usually is regarded as the strong side of 
corpus work, that is, the wealth of authentic data, 
turns against the inexperienced user, as the case 
of since makes quite clear: Relevant and useful 
tokens are often hidden among a large number of 
instances that do not exemplify the phenomenon 
under scrutiny at all or are not very typical. This 
is due to phenomena like polysemy or homonymy 
(as in the case of causal since) and the diversity 
of uses of a particular lexical item. 


The Problem of Language Varieties 
and Genres 


The question of varieties and genres concerns 
the more general problem of drawing the right 
conclusions from corpus data. This is not an easy 
task as Sinclair (2004) remarks: “[...] a corpus is 
not a simple object, and it is just as easy to derive 
nonsensical information from the evidence as 
insightful ones” (p. 2). A case in point is the use 
of prepositions in different national varieties of 
English. It is a well-known fact that British and 
American English differ with regard to the use 
of prepositions with particular lexical items. An 
example would be the adjective different and the 
use of prepositions from, to, and than. The Long- 
man Dictionary of Contemporary English, for 
instance, tells the reader that from and to are both 
common in British English, whereas than is more 
common in American English. This observation 
is corroborated by a comparison of the Michigan 
Corpus of Academic Spoken English (MICASE) 
containing 1,848,364 words and a comparable 
spoken selection of the British National Corpus 
totaling 2,279,554 words. MICASE only contains 
spoken academic English the sub-section of the 
BNC contains spoken material like lectures, public 
discussions or discussions on TV and interviews 
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Table 1. Frequencies of prepositions from, to and than after different in MICASE and a comparable 


sub-section of the BNC 


different ... 

from 77 41.66 
to 3 1.62 
than 46 24.89 


with people from a mostly academic background 
(Table 1). 

As Table 1 shows, different from is used 
similarly in American and British English but 
huge discrepancies are observed with the other 
two prepositions: to is very rarely used in the first 
variety but quite frequent in the second, while 
the situation is reversed for than (see also Mair, 
2007, for similar findings for North-American 
as opposed to British or British-influenced web 
domains). To the linguist and to the teacher such 
differences in varieties are obvious and thus do 
not pose a problem in their work with corpora. 
To the untrained student, however, such phenom- 
ena may lead to drawing the wrong conclusions 
from a corpus simply because the corpus was 
ill-chosen. 

Related to the question of varieties is that of 
genres within one particular variety. Not every 
attested use of a particular construction found 
in a corpus is appropriate for use in any given 
situation. The most obvious examples are found 
in comparisons of spoken and written language. 
Illustrative in this respect is Mukherjee’s (2002) 
discussion of let me. The expression is used very 
frequently in both spoken and written English, 
as a look at the British component of the Inter- 
national Corpus of English (ICE-GB) shows: 68 
instances in roughly 600,000 words of spoken 
English and 45 instances in 400,000 written words. 
It is important to note, though, that most of the 
instances in the written component of ICE-GB 
(38, i.e., 84 percent) come from the 61,577—words 
‘correspondence’ section of the corpus. Within 
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MICASE (absolute) MICASE (per million words) BNC (absolute) BNC (per million words) 


92 40.36 
36 15.79 
10 4.39 


the spoken component instances are distributed 
evenly across the categories ‘dialogue,’ ‘mono- 
logue’ or ‘mixed.’ That is, while at first sight the 
expression seems to be used both in written and 
spoken English alike, a closer look at the data 
reveals its confinement to one particular genre of 
written language, namely letters. This clear divi- 
sion entails formal and functional differences. As 
Mukherjee (2002, p. 91) points out, the patterns 
where instances of let me in letters enter can be 
summarized in Diagram 1. 
Some of the patterns are exemplified: 


11. ... if you would let me know as soon as 
possible ... (ICE-GB: wlb-018 #072) 

12. Letme know more details about your plans. 
(ICE-GB: w1b-015 #030) 

13. Would you please let me know what you 
suggest ... (ICE-GB: wlb-026 #097) 

14. If you would like to purchase the set please 
let me know ... (ICE-GB: w1b-030 #071) 

15. Can you please let me have more informa- 
tion about ... (ICE-GB: wib-017 #008) 


According to Mukherjee (2002) these patterns 
are mainly used to formulate requests for action 
or for further information, a function that is very 
important in letters, if not always the main func- 
tion. Of course, the above phrases could also be 
used to request information in spoken English, 
but to the native speaker, it would sound highly 
unidiomatic. In spoken language let me occurs 
in completely different patterns and, more im- 
portantly, in different functions, namely (1) as a 
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Diagram 1. The use of let me in letters (Mukherjee, 2002, p. 91) (Copyright 2002, Peter Lang GmbH, 


Frankfurt am Main, Germany. Used with Permission) 


please (do) let me 


if-clause (please) let me know 


I would be grateful if you would let me know/have = + 


if / wh- ... 
noun-group 

know as soon as possible 
and I will... 


have + noun-group 


filler in such expressions as let me think or let me 18. 
see, and (2) as a discourse organizer (Mukherjee, 
2002, p. 92); consider examples (16) to (18): 


16. [think being Prince of Darkness is actually 
quite an attractive title isn’t it <laughter> 
Probably more attractive than Minister for 
the Arts in some ways 
But let me just deal first with two of the 
general points made 
I mean first the politics of this (ICE-GB: 
slb-022 #66-#70) 

17. No doubt he would equally be a very expe- 
rienced colleague were he to be uh Foreign 
Secretary in a government led either by 
Michael or myself 
so his experience will still be available 


And lastly for falsetto the the cords are very 
stretched and thin to produce this kind of 
voice quality <> 

so we find that we have a very small contact 
<,> very very many contacts over a period 
of time <> and that gives us this high fre- 
quency high pitch <> voice that we perceive 
as falsetto <,,> 

So let me now just talk a little bit about an 
application 

And one application one thing that we ‘ve 
been using in research and now is actually 
being used in speech therapy clinics <,> is 
the fact that we can actually listen as well 
as look at the laryngograph signal <> (ICE- 
GB: s2a-056 #77-#80) 


But let me put it to you this way <,> While let me constructions are appropriate for 
Three hundred and seventy-two of my col- organizing spoken discourse it does not usually 
leagues know each of us extremely well occur in this function in written language. Again, 
ouse of Commons is like a village as you the learner who is not aware of genre differences 
well know (ICE-GB: sib-043 #086-#090) may draw the wrong conclusions from corpus 
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analysis. Here, for example, a learner might as- 
sume that let me is a good way to introduce a 
topic shift in one’s own writing. 


The Problem of Interpreting 
Frequencies 


Frequency information is usually not accessible 
to the intuition of the researcher but is one of the 
strong points of corpus linguistics, which is most 
probably why the interpretation of frequencies has 
always been at the centre of the corpus linguistic 
enterprise. Frequencies as such, however, are not 
always of great value to the researcher, let alone 
the foreign language student. A given expression 
or construction might be frequent in a corpus 
because it is frequent in a particular genre or 
merely because it is one of the idiosyncrasies of 
a particular writer or speaker. It follows that high 
frequency itself does not guarantee idiomaticity 
and general applicability of a given expression or 
construction. A similar caveat also applies in the 
opposite direction. Expressions that are not found 
in a given corpus need not be ungrammatical or 
otherwise incorrect. For instance, reports that the 
two-million-words German-English Translation 
Corpus of “The Chemnitz Internet-Grammar’ 
does not show any uses of brief where the lexical 
item denotes an extension in space. It would be 
wrong, however, to conclude that such uses are 
incorrect, as a look in the much larger British 
National Corpus (100 million words) makes clear. 
Here we find instances like brief bikini, brief bikini 
panties, brief black dress, or brief black shorts, 
which indicates that brief may well be used with 
clothing articles. Obviously, the interpretation 
of frequency data is far from trivial and needs 
training and awareness of genre, idiosyncrasies 
and of the influence of corpus size and represen- 
tativeness. 
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SOME BENEFITS OF WORKING 
WITH A CORPUS 


As section 2 has made clear, corpus analysis is not 
at all trivial and may pose great difficulties to the 
learner of a foreign language. On the other hand, 
working with a corpus has many advantages over 
more traditional methods of language learning. 
Some of these will be discussed briefly. 

The main argument in favor of working with 
corpus data is that it is ‘data-driven learning,’ 
or DDL (Johns, 1991, 2002). The general idea 
behind this approach is that of the learner as 
researcher: 


My approach was rather to confront the learner 
as directly as possible with the data, and to make 
the learner a linguistic researcher. The metaphor 
I use with my student is that of the detective, 
‘Every student a Sherlock Holmes!’ (Johns, 2002, 
p. 108) 


It is important to note that DDL in general 
and corpus analysis in particular involves “not 
only methodological questions of how language 
is to be taught and learned but also substantial 
questions of what is to be taught and learned” 
(Johns, 2002, p. 110). Similarly, Hunston (2002) 
emphasizes that DDL 


supports learning, partly because students are 
motivated to remember what they have worked 
to find out. In addition, because corpus data can 
reveal previously unnoticed patterns, a student 
may well notice something that a teacher has 
overlooked, or that no textbook covers (170). 


In addition to motivational advantages and the 
serendipity of learning through corpus data, the 
learner “learns how to learn through exercises 
that involve the observation and interpretation of 
patterns of use” (Bernardini, 2004, p. 16). 
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It follows from these observations that a change 
of the role of the teacher is inherent if students 
are working with a corpus. Although “the role of 
instructor or oracle does not shift from teacher to 
corpus” (Bernardini, 2002, p. 166), the teacher 
is given less prominence, he or she “becomes a 
coordinator of research or facilitator” (Bernardini, 
2004, p. 16). From here it is only a small step to 
understanding the corpus as a learning tool that 
can be used even without the assistance of the 
teacher, a tool that, similar to a dictionary, is used 
outside of institutionalized contexts and supports 
life-long language use and language learning. 

As has been shown, the use of corpora is not 
entirely unproblematic. Consequently, students 
need to be taught how to work with corpora, they 
need to develop a corpus competence that allows 
them to benefit from the advantages of corpus 
linguistic methods while at the same time keep- 
ing the problematic aspects at bay. As Mauranen 
(2004) points out: 


[...] if we wish to be maximally learner-centred, 
or construct the learner as a ‘researcher,’ he or 
she needs skills and guidance in dealing with the 
kind of data a corpus provides. [...] this is learn- 
able, but what I want to emphasise here is that 
corpus skills constitute a learning task in them- 
selves, much in the way that many other subskills 
of learning do, such as group work skills. Once 
acquired, they facilitate learning greatly and need 
not be constantly refreshed (p. 99). 


The next section sketches out what kinds of 
skills are needed to successfully work with a 
corpus even without the guidance of a teacher. 


ASPECTS OF CORPUS 
COMPETENCE 


It is clear that corpus competence must provide 
answers to the problems of interpreting corpus 
data that were discussed in section 2. In addition, 


however, corpus competence must also involve 
skills of a more general kind, skills that have to 
do with background knowledge about corpus 
linguistics and corpus methodology. These will 
be dealt with first. 

With regard to background knowledge, it is 
indispensable that students shouldbe familiar with 
some rudimentary facts about corpus linguistic 
methods, that is, about what corpora can do and 
what they cannot do. A basicinsight inthis respect 
is that you can only take from the corpus what 
others have put into the corpus. Some corpora 
are mere collections of unannotated texts, many 
corpora are part-of-speech tagged and only very 
few corpora are syntactically analyzed and parsed. 
The questions that a given corpus can answer 
obviously depend on the degree of annotation. 
While lexical search runs will be possible with 
any corpus, more sophisticated questions such as 
the use of particular clause patterns or syntactic 
constructions can only be answered with parsed 
corpora. Students should be aware of the fact that 
most corpus searches will be of a lexical kind and, 
accordingly, that most analyses will take a single 
lexical item as their starting point. A corpus will 
thus be able to provide answers as to the words 
that are used with a given item and to some degree 
even about syntactic patterns, but analyses of a 
more abstract kind are usually only possible with 
more refined corpora and often involve knowl- 
edge beyond that of the layman. Luckily, lexical 
searches can take the student a long way so that 
it seems reasonable to teach students how to get 
the maximum out of these searches rather than 
bothering them with more sophisticated corpora 
and corpus tools. 

One important aim would thus be to enable 
students to work with concordances. In particular, 
students need to be familiar with different ways of 
sorting concordance output since this will reveal 
the different patterns that a particular lexical item 
enters. Sorting to the first word on the right, for 
instance, gives insight into the prepositions that 
are used witha given word. By way of illustration, 
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let us consider the lexical item married. This word 
is problematic for German as well as French and 
Italian learners with regard to the use of married 
to vs. married with. In all of the three languages 
interferences are to be expected when translating 
the phrases verheiratet mit, marié avec, sposato 
con into English, since the verbatim translation of 
the prepositions would result in the wrong transla- 
tion married with. A right-sorted concordance of 
the word quickly reveals that the main prepositions 
following married are to, in, and with. In addition, 
three further patterns emerge, namely (in order of 
descending frequency) married woman/women, 
married couple/s, and married man/men. 


19. POOR Elizabeth Harris moans about being 
married to two millionaire stars, ... (BNC: 
CH5_801). 

20. He was married in September to Ann 
Henderson (BNC: HSO_385). 

21. Anderson, married with two children, at- 
tacked the woman in a deserted ... (BNC: 
A59_511). 

22. She was a married woman, who said she 
met him on a plane, ... (BNC: CBF_251). 

23. In 1988, 62 percent of married couples 
of working age were both in work (BNC: 
AP5_827). 

24. ... living standards for a married man on 
average earnings ... (BNC: HHV_19095). 


Sorting to the left identifies the kinds of verbs 
that usually occur with married: In addition to 
various realizations of ‘BE married, the students 
will find that the pattern “GET married’ is also 
very frequent: 


25. She told him he was lucky to be married 
to a “beautiful, intelligent artiste” (BNC: 


AC3_ 629). 

26. Ihad been married for seven hours (BNC: 
FBL_1000). 

27. ... I would like to get married ... (BNC: 
HGY_1554). 
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28. You just got married in the barn (BNC: 
K6R_400). 


Furthermore, students should also be aware of 
the fact that collocations like those above again 
can be part of larger patterns. The phrase to be 
married, for instance, occurs with typical lexical 
items, that is, about, engaged, going, have, likely, 
want, and BE in its various forms: 


29. ... just when he was about to be married 
the second time (BNC: H86_3043). 

30. Sheis engaged to be married in July (BNC: 
HS0_552). 

31. “Maria Luisa and I are going to be mar- 
ried!” (BNC: JY4_ 3481). 

32. “No, you have to be married” (BNC: 
CCM_768). 

33. The psychologist also says he’s likely to be 
married (BNC: FAB_1976). 

34. “When do you want to be married then?” 
(BNC: A6N_1000). 

35. They’re to be married in May in Dingle 
(BNC: HGL_2523). 


In sum, students should know that patterns 
can be found to the right and to the left of a given 
search word and they should be aware of the fact 
that patterned behavior often extends over several 
words to the left or the right. Consider in this 
context Sinclair’s (1996) discussion of naked eye 
and his (1998) description of budge. 

Finally, to make pattern search more efficient, 
the use of regular expressions and wildcards 
need to be introduced, thus allowing for at least 
some degree of abstraction in the search string. 
Students could thus search for the abstract string 
‘BE + married’ instead of running searches for 
all the individual realizations like be married, 
am married, and so on. 

Being able to work with concordancers is per- 
haps the most fundamental skill in working with 
corpora. However, in addition, students need to 
be able to interpret the data that the concordancer 
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yields. This addresses the problem areas that have 
been discussed in section 2 of this chapter; each 
of which will be dealt with in turn. 

The first problem, exemplified with regard to 
the use of aspect with since, was the wealth of 
data and the problem of finding the relevant tokens 
therein. The answer to this problem touches on 
different issues: (1) Is the corpus appropriate (as 
regards the degree of annotation) for the kind of 
phenomenon that the analysis aims at, and (2) 
can concordance data provide insight into the 
phenomenon under scrutiny? The first question 
is not answered easily. Since we are dealing with 
a grammatical phenomenon rather than a lexical 
one, it could be argued that an unparsed corpus, 
is not a particularly useful choice. On the other 
hand, the phenomenon can be tackled with a 
lexical search since all of the cases the researcher 
is interested in contain the lexical item since. In 
principle, and this answers the second question, 
a concordancer can provide insights into a gram- 
matical phenomenon if it is in some way or other 
related to a specific lexical item or a lexically 
specifiable class of items. However, students need 
to be aware of the fact that the search run will not, 
and cannot, be very precise. Concordance lines 
will often provide lots of data that illustrate a dif- 
ferent phenomenon altogether, this is due to many 
cases of homonymy or polysemy in the English 
language. Furthermore, authentic language is 
usually very different from textbook examples 
or illustrations in dictionaries. The student must 
be prepared to find relevant instances that are 
not prototypical and to encounter tokens that are 
difficult to understand. Finally, and maybe most 
importantly, students experience directly that 
authentic language use is often less rigid than the 
grammatical rules that are stated in textbooks at 
school or university. The following remark by 
Romer (2006) shows that this experience is not 
necessarily welcomed by students: 


“[...] German students are often rather reluctant 
when it comes to accepting corpus evidence that 


runs counter to their intuition and to what they 
have learnt about the language at school. The 
corpus and the concordance seem to be the ‘bad 
guys’ who destroy their orderly world of clear- 
cut grammatical rules and clear right-or-wrong 
decisions” (Romer, 2006, p. 128). 


A case in point is the use of would in the if- 
clause in conditional clauses. In addition to typi- 
cal uses of an item, corpora will also reveal less 
typical, peripheral uses. Inducing grammatical 
rules into data of actual language use therefore 
involves skills in interpreting frequencies which 
will be dealt with in more detail below. For now 
let it suffice to say that students need to know 
that, in principle, anything can be looked up in 
the corpus that in some way or other can be con- 
nected to a lexical item. In many cases concerning 
grammatical phenomena, however, the effort that 
is needed to ‘separate the wheat from the chaff’ 
is unreasonably large. Consequently, the student 
would be best advised to consult a grammar or 
a dictionary instead. For lexical, or mostly lexi- 
cal phenomena, a look into the corpus will most 
probably yield interesting and useful results. 

While the first problem concerns the annota- 
tion of the corpus, the second one, that is, the 
influence of varieties and genre concerns the 
question as to what part of a particular language 
(in its broadest sense) the corpus tries to represent. 
This seems trivial to the experienced linguist 
and researcher but nevertheless it is a point that 
needs to be made clear to the student. At the most 
general level, students should be familiar with 
the fact that there are different national varieties 
of the English language and that each of these 
varieties has its own special features as regards 
lexis, grammar and idiomatic usage. Accordingly, 
it makes a difference if a particular phenomenon 
is investigated with the help of, say, the Lancaster- 
Oslo-Bergen (LOB) or the BROWN corpus, as 
they represent British and American English, 
respectively. In addition, knowledge about the 
existence of different registers and genres is 
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indispensable. Idiomatic writing, for instance, is 
very different from idiomatic speech and students 
may thus be ill-advised to consult either the LOB 
orthe BROWN corpus to enhance their idiomatic- 
ity in speaking, since neither of the two corpora 
contains any spoken material. Similarly, as was 
shown in section 2, a given expression may occur 
in different patterns and have different functions 
in speech and in writing. It follows that patterns 
and functions that are identified in corpus data 
need to be analyzed with regard to correlations 
with particular registers and genres. It is only 
then that the corpus will provide a useful tool for 
enhancing idiomatic and appropriate language 
use. A prerequisite in this regard, however, is 
that students have some rudimentary knowledge 
about individual corpora, such as the material and 
genres that are covered, the time period that the 
selection represents and the size of the corpus. In 
addition, students need to be able to identify the 
genres a given token is taken from. This will usu- 
ally involve some knowledge about the design of 
the corpus and the codes that are used to identify 
the individual documents within a corpus. 

The final problem discussed in section 2 con- 
cerns the role and interpretation of frequencies. A 
first fundamental distinction that students need to 
be aware of is that between absolute and normal- 
ized frequencies. Only the second frequency value 
will usually be relevant since the first, of course, 
depends on the size of the corpus. In interpreting 
normalized frequencies, however, the following 
caveats need to be considered. (1) High frequen- 
cies do not necessarily mean that a particular 
expression is appropriate in all situations of use; 
(2) low frequencies do not necessarily indicate 
that the expression is odd or unidiomatic; and (3)a 
frequency of zero does not necessarily mean that 
the expression is ungrammatical or incorrect. 

As to the first caveat, although high frequencies 
are generally a good indicator of idiomaticity and 
students therefore should focus on highly frequent 
expressions, students should also be aware of the 
influence of genre and register discussed above. A 
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given expression might be very frequent in genre 
A, for instance spoken English, but almost non- 
existent in genre B, for instance written English. 
That is, highly frequent expressions should not 
be taken as idiomatic expressions for English in 
general and frequency variation across genres 
must be taken into account. 

The other side of the coin is the interpretation 
of low frequencies, caveat (2): a given expression 
might be rather rare in the whole corpus but tokens 
may cluster within one particular genre, such as 
written legal English, written academic English 
or personal and public correspondences. In this 
case, students should not discard the expression 
altogether but rather try to memorize it as a use- 
ful piece of language in particular situations. If 
an expression does not occur at all in a corpus, 
caveat (3), students should first try to find a larger 
corpus and check there. If the larger corpus does 
not provide any instances either, this does notmean 
that the expression at issue is incorrect. Atthe most 
this indicates that the expression is rather rarely 
used and that it is likely to be unidiomatic. 

Students should be aware of what the corpus 
actually represents. If astring of lexical items does 
not occur in, say, the BROWN corpus, this might, 
at least, indicate three things: (1) it is uncommon 
in American English but may be used in British 
English, (2) it is uncommon in written English 
but may be used in spoken English, and (3) it is 
uncommon in the English of the 1960s but may 
be used today. (To be more precise, the number 
of potential explanations is much larger, since 
the individual aspects can be combined, that is, 
uncommon in written American English of the 
1960s but common in written American English 
of the 1990s or common in spoken American 
English of the 1990s and so on). The students, 
thus, may want to check the same expression in 
the LOB, the FLOB and the FROWN corpora. 
The first two are corresponding corpora of British 
English for the 1960s (LOB) and 1990s (FLOB), 
and FROWN represents written American English 
of the 1990s. But even if no instances are attested 
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in other corpora this can never be interpreted as 
an indication that the expression is incorrect—a 
corpus cannot give evidence as to ungrammati- 
cality. This information can only be provided by 
native speakers or reference works. 

The skills discussed so far will guarantee 
that students are able to use concordancers and 
are able to interpret the data that a concordance 
yields. The final skill that is needed to make the 
corpus a tool for lifelong learning is knowledge 
about how to get access to corpora and corpus 
software. Similarly to dictionaries, corpora and 
software come in many shapes and forms, and, 
quite often, they are expensive and thus not af- 


Diagram 2. Aspects of corpus competence 


fordable to students. It follows that as soon as 
students leave school or university, they will not 
have access to the (maybe expensive) corpora 
that hitherto had been available. Fortunately, the 
Internet provides a number of corpus-linguistic 
resources, as a search run for ‘corpus,’ ‘corpora,’ 
‘corpus software,’ or ‘concordancer’ with the usual 
search engines, such as Google or Yahoo, shows. 
In an instant, students will get access to a huge 
numberof corpora and concordancers, the problem 
being how to choose from the many on offer. In 
this respect the other skills described above are 
very useful, that is, knowledge about degrees of 
annotation of corpora, about concordancers and 


Dealing with a 
wealth of 
authentic data 


Knowledge about 
national varieties 
and genres 


Interpreting 
frequencies 


Corpuslinguistic 
background: 
What corpora can 
do and what they 
cannot do 
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- variety represented 


spoken or written? 
genres represented 
size 

date of materials 
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variation in use 
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what to do with them, and finally about what kind 
of English the different corpora want to represent. 
Keeping these aspects in mind, students will be 
able to pick those corpora and those tools that are 
appropriate for the analyses they want to conduct. 
The corpus can thus become a tool for life-long 
non-institutionalized learning. 

Ihave discussed several skills that, in my view, 
are indispensable if we want to make the corpus 
a lifelong learning tool for students after school 
or university. In Diagram 2, the individual skills 
are presented and the ways in which they are 
interrelated are brought out in more detail. 

As Diagram 2 shows, corpus competence 
involves different kinds of skills and knowl- 
edge: (1) a skill of interpreting corpus data, (2) 
knowledge about corpus design and individual 
corpora, (3) knowledge about resources in the 
Internet, (4) some general linguistic background, 
(5) knowledge about how to use concordancers, 
and (6) some corpuslinguistic background. The 
first skill can be subdivided into three different 
aspects, that is, knowledge of how to deal with 
a wealth of authentic data, knowledge about 
genres, and varieties and skills in interpreting 
frequencies. As the diagram shows, these skills 
are interrelated in various ways. Student will be 
able to deal with authentic data if they have some 
general corpus linguistic background (skill 6). 
This will help them to ask the right corpus the 
right questions. In addition, some basic linguistic 
knowledge (skill 4) will prepare students to expect 
interpretation difficulties due to phenomena like 
polysemy or homonymy and due to the fact that 
language use is often more varied than students 
might assume given the nature of textbook rules 
they will have learnt at school. Competence in the 
use of concordancers (skill 5) will help students 
to frame the question they want to ask in such a 
way that the concordance data will provide as 
much information about the phenomenon under 
scrutiny as possible. The second aspect that comes 
under ‘interpreting the data’ is knowledge about 
national varieties and genres. This relates to basic 
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knowledge about corpora and corpus design (skill 
2) but is especially important with regard to the 
interpretation of frequencies, which, again, relates 
to knowledge about corpora and corpus design as 
well as to basic knowledge in linguistics. Finally, 
(skill 3), knowledge about Internet resources, 
depends on the corpus linguistic background, 
knowledge about concordancers, about corpus 
design and individual corpora. 

Having described the most important aspects 
of corpus competence, the final section sketches 
out a way of teaching corpus competence at school 
or university. 


TEACHING CORPUS COMPETENCE 


Teaching these individual skills would best start 
with teaching students how to interpret corpus 
data. A good starting point in this respect would 
be pre-edited concordance lines which provide 
an optimal illustration of the phenomenon to be 
studied. Even at this early stage, the influence of 
genre and register and the need to interpret fre- 
quencies correctly could be brought to the atten- 
tion of the students. At the second stage students 
would be confronted with the raw concordance 
data that underlie the edited concordance lines. 
Here, students would get an idea of the preci- 
sion (or imprecision) of concordancers and also 
an impression of the different shapes and forms 
which a particular phenomenon can take in actual 
language use. This would be a good occasion to 
discuss the relation ofrigid grammatical rules and 
variation in authentic language use and to teach 
some basic linguistic concepts that are useful in 
the interpretation of raw concordance data. It is 
important to note that working with raw data 
would also allow students experience that within 
this (maybe overwhelming) wealth of data they 
can find the information they are actually looking 
for, since the raw concordance data was the basis 
for the pre-edited concordance lines. 
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After this introduction into basic skills in in- 
terpreting concordance lines students should be 
led to work with concordancers on their own. This 
would first involve replicating data sets that the 
teacher had produced before. A later task might 
be to provide the students with a number of pat- 
terns that a particular lexical item occurs in and 
ask them to identify these patterns with the help 
of concordancing software. In this way, students 
would learn the use of wildcards and the use of 
sorting procedures. 

The next step would be to teach corpus-lin- 
guistic background, including aspects of corpus 
design and knowledge about individual corpora. 
On the basis of this newly gained knowledge 
students could go back to the concordance lines 
that have previously been analyzed and assess the 
suitability or unsuitability of the database from 
a genre and register perspective. Also, students 
should experiment with identical search runs on 
different corpora and see how this changes the 
results. This would heighten their awareness of 
register and genre influences. 

At this stage, students will be independent of 
the teacher in terms of interpreting corpus data 
and of choosing the right corpus and formulating 
the right questions with the help of a concor- 
dancer. The final step to achieving full corpus 
competence is becoming independent of the 
resources that school or university provides. As 
said above, asimple search for ‘corpus,’ ‘corpora,’ 
‘concordancer’ and similar key words in Google 
or other search engines will provide a vast amount 
of possibilities to access and exploit corpora. On 
the basis of their knowledge of corpus linguistics 
in general, their knowledge on corpus design and 
individual corpora and their proficiency in work- 
ing with concordancers students will be able to 
identify those programs and Web sites that are 
most suitable for their demands. 


CONCLUSION 


This chapter has emphasized the need to enable 
foreign-language learners to work with corporain 
and out of institutionalized contexts and has made 
a plea for teaching students corpus competence, 
a set of skills which aims at making the corpus a 
tool for non-institutionalized and life-long learn- 
ing. The most important of these skills is that of 
interpreting raw corpus data, since the student 
that is confronted with raw corpus data will facea 
number of serious problems in interpreting them. 
These problems have been discussed in some 
detail and suggestions have been made to enable 
students to come to grips with them. Other aspects 
of corpus competence involve basic knowledge 
of linguistics, corpus linguistics, corpus design 
and individual corpora and some proficiency in 
working with concordancers. Finally, knowledge 
about how to open up the vastrepository of corpora 
and corpus tools in the worldwide web will make 
students truly independent of corpora in school 
or at university and of the guidance of teachers 
in exploiting them. 

Corpus competence, as described in this 
chapter, thus, will turn the corpus into a tool 
for non-institutionalized and self-responsible 
learning. Students equipped with this kind of 
competence will have at their disposal massive 
amounts of authentic language data that hitherto 
have not been accessible to them. They will be 
able to use these data to increase their language 
proficiency throughout their whole life, thus en- 
hancing their language skills in many different 
areas and becoming ever more competent users 
of their foreign target language. 
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KEY TERMS 


Corpus: A collection of annotated or unan- 
notated texts used for linguistic analysis. 


Concordancer: A tool to exploit corpus data. 
A concordancer searches a given corpus for an 
individual (usually lexical) item or a set of items, 
identifies each occurrence of the search expression 
in the corpus and provides all instances together 
with its surrounding context. 


Frequency, Absolute: The number of occur- 
rences of a particular item in a corpus. 


Frequency, Normalized: Since absolute 
frequencies depend on the size of the corpus, 
absolute frequencies are usually normalized, 
that is divided by the total number of words in 
the corpus. Normalized frequencies of individual 
corpora are comparable even if the corpora are 
of different sizes. 


Genre: A way of categorizing texts which does 
notinvolve any linguistic knowledge or expertise. 
Examples are the categorizations found in librar- 
ies and categories like ‘spoken,’ ‘written,’ ‘crime 
fiction, ‘newspaper texts.’ 


Register: A way of categorizing texts ac- 
cording to the situation in which these texts are 
used. The concept of ‘register’ tries to capture the 
intuition that the situation of use has an impact on 
the way language is used. Illustrative examples 
are the differences in language use when talk- 
ing to intimate friends as opposed to talking to 
superiors at work. 


Representativeness: No corpus can capture a 
complete language. Instead corpora are regarded 
as samples of a given language. Being a sample, 
corpora try to be representative of a particular 
language or parts thereof. The BROWN corpus, 
for instance, tries to represent written American 
English from 1961. 
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ABSTRACT 


Since the early 1990s, researchers have been investigating the effectiveness of corpora as a resource 
in language learning, mostly creating their own small corpora. As it is neither feasible nor desirable to 
envisage a future in which all teachers create their own corpora, and as the content of language courses 
is similar in many universities throughout the world, the sharing of resources is clearly necessary if 
corpus data are to be made available to language teachers and learners on a large scale. Taking one 
small corpus as an example, this chapter aims to investigate the issues arising if corpus consultation 
is to become an integral part of the language-learning environment. The chapter firstly deals with fun- 
damental questions concerning the creation and reusability of corpora, namely planning, construction, 
documentation, and also legal, moral and technical issues. It then explores the issues arising from the 
use of a corpus of familiar texts, in this case a French journalistic corpus, with advanced learners. In 
conclusion we propose a framework for the optimal use of corpora with language learners in the context 
of higher education. 


INTRODUCTION effectiveness of corpora as a language-learning 

resource often prefer to give their learners access 
Despite the existence of vast corpora in sev- to smaller corpora. Dodd (1997) recommends a 
eral languages, researchers investigating the one-million-word corpus as an optimal resource 
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for learners. Notable exceptions are Bernardini 
(2000, 2002) and Cheng, Warren and Xun-feng 
(2003), who advocate large corpus concordancing 
by learners, accompanied by pedagogic mediation 
(Widdowson, 2003) by the teacher. 

Smaller corpora may be extracted from larger 
corpora, as in the case of BNC Baby (Burnard, 
2004), which consists of four subcorpora of ap- 
proximately one million words of journalistic, 
academic, literary, and spoken texts in English, 
extracted from the British National Corpus. Most 
of the smaller corpora, however, have been cre- 
ated by the researchers specifically to provide 
a resource for the learners, what Braun (2005) 
terms “pedagogically relevant corpora” (p. 49). 
They generally consist of two types. Firstly, the 
teacher/researcher may create a corpus of famil- 
iar texts, such as course materials (Cobb, 1997; 
Stevens, 1991), recommendedreading (O’ Sullivan 
& Chambers, 2006), texts of general interest such 
as newspaper and magazine articles (Kennedy & 
Miceli, 2001, 2002), or acombination of academic, 
journalistic and other familiartexts (Johns, 1997). 
It is easy to understand this preference for small 
corpora. As Aston (1997) notes, consulting asmall 
corpus of texts belonging to one genre is a more 
manageable task than consulting a vast corpus with 
texts from several genres, which is less likely to 
provide expressions corresponding to the needs of 
the learner. It follows that in a language resource 
centre, a learner would ideally be able to consult 
a variety of corpora, including conversations or 
journalistic discourse for language learning ina 
general context, and genre-specific corpora of, 
for example, literary, historical or scientific texts 
to respond to more specialised needs. 

University language courses throughout the 
world, both for language specialists and students 
of other disciplines, have much in common, thus 
making the sharing of resources in the form of 
corpora seem feasible. However, Fligelstone’s 
(1993) scenario, in which a teacher can advise a 
learner to “go to any of the labs, hit the icon which 
says ‘corpus’ and follow the instructions on the 


screen” (p.101), remains as futuristic today as when 
the article was first published. Many researchers 
create corpora for use only with their learners, 
thus limiting the application of the research on a 
widerscale. Developments are nevertheless slowly 
taking place involving the creation of corpora 
specifically intended for learners, and this raises 
three important questions: 


. What are the optimal conditions for the 
creation and reutilisation of corpora? 

. What conditions are necessary for learners 
to benefit from corpus consultation? 

° How can small corpora created by individu- 
als or groups of researchers be integrated 
into the wider language-learning environ- 
ment? 


This chapter will address these questions in 
turn. After a brief consideration of the theoretical 
and pedagogical issues underpinning the use of 
corpus data by learners, it will outline a number 
of general principles in relation to making a 
corpus that can be used and shared. This will be 
followed by an illustration of how a corpus, in 
this case of newspaper articles in French, can be 
used as a language-learning resource, focusing 
in particular on the challenges which a journal- 
istic corpus, containing as it does a wide variety 
of contexts, poses for both teacher and learner. 
Finally a simple framework for the integration of 
corpus data in the language learning and teaching 
context will be proposed. 


CORPUS CONSULTATION AND 
LANGUAGE LEARNING: 
THEORETICAL AND PEDAGOGICAL 
CONTEXT 


Research on the theoretical and pedagogic un- 
derpinning of corpus consultation by learners 
focuses on a number of areas, namely the im- 
portance of frequency in language learning, the 
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authenticity of the data, the presence or absence 
of context, corpus consultation as a cognitive and 
constructivist activity, and the role of corpora in 
contexts such as a process-oriented approach to 
language learning. As a detailed analysis of all 
of these is well beyond the scope of this chapter, 
this section very briefly outlines the major issues 
involved, providing references to more detailed 
studies where they exist. Ellis (2002) stresses the 
importance of frequency in language learning, but 
notes that, despite substantial research by Lado, 
it fell out of favor, linked as it was to the audio- 
lingual method which Lado had championed (p. 
177). For Ellis (2002) what learners need is not 
the mindless repetition of phrases characteristic 
of behaviorism, but “mindful repetition in an 
engaging communicative context by motivated 
learners” (p. 177). Not only do corpus data provide 
learners with what Cobb (1997) terms “multicon- 
textual learning” (p. 303), they also give them 
access to naturally occurring discourse rather 
than invented examples. 

On the issue of whether these genuine examples 
can be considered as authentic and as providing 
contextual information, conflicting views have 
been expressed by researchers such as Widdowson 
(2000, 2003) on the one hand, and on the other 
by those actively involved in the use of corpora 
by learners and teachers (See, for example, Cobb, 
1997; Johns, 1997). Perhaps the most important 
aspect of corpus consultation in a pedagogical 
context is that it is particularly well suited to the 
currently accepted paradigm in language learn- 
ing which emphasizes “the need to find ways 
for students to take more active, reflective and 
autonomous roles in their learning” (Hyland, 
2002, p. 120). In addition, corpus consultation 
fits well in a process-orientated approach to 
language learning (see O’Sullivan, 2006, for a 
detailed analysis). 

Since the early 1990s there has been a steadily 
increasing number of empirical studies devoted 
to consultation by learners of corpus data as a 
means of learning a language. Within the vast 
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global activity of language learning and teaching, 
however, it seems that direct corpus consultation 
by teachers and learners is rare. Early publica- 
tions by Johns (1986, 1988) involve international 
students at the University of Birmingham. The 
more recent studies which have been published, 
by Bernardini (2000, 2002), Cheng et al. (2003), 
Kennedy and Miceli (2001, 2002), O’Sullivan 
and Chambers (2006), Yoon and Hirvela (2004), 
and others involve learners in higher education 
and include information on the training provided, 
the searches carried out by the learners, and their 
reactions to the activity. 

Qualitative studies of learners’ reactions gen- 
erally confirm the advantages highlighted in the 
theoretical context previously outlined, while also 
revealing certain disadvantages. Some learners 
appreciate the cognitive and constructivist aspect 
of the activity, and the great variety of examples 
provided in contrast to the much more limited 
number which they can find ina dictionary, course 
book or grammar (Chambers, 2005; Cheng et al., 
2003; Yoon & Hirvela, 2004). Positive reactions 
also include learners’ appreciation of the relevance 
(Bernardini, 2002) and authenticity (Chambers, 
2005; Cheng et al., 2003) of the data, and of the 
abundance of examples which they consider to be 
a major advantage of the corpus over the diction- 
ary (Cheng et al., 2003; Chambers, 2005; Yoon & 
Hirvela, 2004). Learner evaluations also include 
positive comments on the self-directed nature of 
the activity, appreciating that they “have a say” 
in what they do (Bernardini, 2002). On the other 
hand some learners in a number of studies find 
analysing the data difficult or laborious (Cham- 
bers, 2005; Cheng et al., 2003; Yoon & Hirvela, 
2004). Yet, if the issue of training can be resolved 
by integrating it into the work of language resource 
centeres or writing centeres, as implied in the sce- 
nario suggested by Fligelstone (1993), corpus data 
clearly have an important role to play in language 
learning and teaching in institutional contexts. In 
addition to the qualitative studies referred to above, 
quantitative studies (Cobb, 1997; Gaskell & Cobb, 
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2004; Stevens, 1991) clearly demonstrate that, for 
both vocabulary and grammar, consultation of 
concordances produces better results in tests than 
traditional language-learning exercises. 


CREATING AND SHARING 
RESOURCES 


While the potential usefulness of corpora and 
other electronic resources may be relatively un- 
controversial today, there are still considerable 
practical barriers to their creation and use. 

The creator of the corpus will have to be able 
to design a corpus, which will involve developing 
strategies for sampling, collecting and organizing 
the texts, as well as a plan for dealing with legal 
and ethical issues, such as copyright and permis- 
sions from speakers. The corpus texts will have to 
be encoded in such a way that the corpus can be 
processed and analyzed by the tools which the user 
is likely to have available such as a concordancer. 
Crucially, the necessary documentation willneed 
to be provided so that the user knows what sort 
of sample of the language the corpus represents 
because only then will the user be able to start to 
make hypotheses or conclusions about language 
usage based on the corpus. This documentation 
needs to be provided in a form so that it is, and 
remains, available to the user. 

In general, the bestroute is to follow guidelines 
and standards, where these are available, in all 
of these areas. A resource is likely to be easier 
to use if it is based on generic text encoding and 
markup formats such as XML, and if it follows 
guidelines for annotation and metadata which 
have already been used on major projects. This 
is because software and support are more likely 
to be available. 

There may be considerable benefits to the 
corpus creator if they are able to make the corpus 
available to other researchers. These potential 
benefits may include: 


. More publicity forthe researchers and for the 
research work that went into developing the 
corpus, opening up possibilities for network- 
ing and further projects and research; 

. The possibility of feedback on the corpus 
design and content, including the report- 
ing of bugs, and the thus the possibility of 
improvements; 

° Other researchers would be able to build 
bigger corpora using your texts, or add ad- 
ditional layers of annotation, thus creating 
more resources which you could use; 

. Other researchers will not have to repeat the 
work to do something similar; 

. Other researchers will be more likely to 
share their resources in return; 

. Research based on the corpus will potentially 
be replicable, which may help to give the 
work more scientific credibility, and could 
lead to further improvements and extensions 
to the work; 

. A linguistic corpus will usually be created 
for a particular pedagogic or research pur- 
pose, but is likely to be a general-purpose 
resource, of use to researchers for other 
purposes, and maybe in other fields; 

. Sharing doesn't mean giving up your rights 
over the data, or due acknowledgement for 
your work; 

. Funders may require making the corpus 
available to the community, and the creators 
may bemore likely to obtain further funding 
if they have a good record in making quality 
resources available. 


If the corpus is to be shared, then usability 
and sustainability are of prime importance. The 
design goal of the corpus creator should be not 
simply to create a resource that can be used 
in their classroom that year, or in a particular 
research project, but to create a resource that 
can be archived, preserved, distributed and re- 
used for as long as possible. A language corpus 
may be created as a snapshot of the modern-day 
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language, but will become useful as a historical 
record of a particular state of the language. It is 
therefore necessary to plan for the full life-cycle 
of the corpus, and provide the necessary docu- 
mentation that will make the corpus usable in 
the future, such as the sources of the texts, the 
sampling strategies and information about dates 
when texts where created and collected. 

The mostimportant way to attain sustainability 
forthe corpus is to avoid tying the use of the corpus 
to dependency on particular people, institutions, 
and technologies. The same measures are also 
likely to make it possible for more people to use 
the corpus in the short term as well. Depositing 
the corpus with a trusted archive can avoid most 
of these problems. The Oxford Text Archive, 
which hosts the UK’s official data centre for cor- 
pora, known as AHDS literature, languages and 
linguistics, can offer advice on corpus creation 
as well as offering an archiving, preservation and 
distribution service. The creators of the corpus 
which is the subject of the following section 
(Chambers & Rostand, 2005), for example, were 
able to avail of advice on issues relating to the 
structure and annotation of the corpus, as well as 
on matters relating to copyright and accompanying 
documentation. Depositing the corpus with the 
archive also provided a means of distributing it 
internationally without the need to involve com- 
mercial partners and costs, which would have 
infringed the conditions of copyright. 

Many of the issues relating to corpus design, 
construction and sustainability are treated in more 
depth in Wynne (2005). 


USING FAMILIAR TEXTS: THE 
JOURNALISTIC CORPUS 


The corpora created by researchers for language- 
learning purposes include both specialized cor- 
pora of texts belonging to a single genre, and texts 
of a more general and varied nature, in particular 
journalistic discourse. Specialized corpora, in- 


442 


Sharing Corpus Resources in Language Learning 


cluding texts such as academic writing, provide 
a valuable resource for learners. For example, 
the learner in search of a solution to a problem is 
likely to find a number of relevant occurrences 
and, perhaps more important, few inappropriate 
occurrences (Aston, 1997). While this type of 
research remains largely dominated by English, 
studies in other languages also exist such as 
Béacco’s (1988) study of the research article. In 
the context of sharing resources, however, possible 
applications of such research are limited by the 
fact that the corpora are not readily available. In 
addition, language learning and teaching in higher 
education does not focus solely on preparation for 
academic writing, and it is thus understandable 
that a number of teachers/researchers choose to 
create and use corpora of more general and varied 
texts. The challenge is arguably greater here than 
in the case of the specialized texts, in that the 
learner will be faced with a variety of contexts, 
and the pedagogic mediation referred to by Wid- 
dowson (2003) will be of greater importance. For 
this reason a journalistic corpus has been chosen 
to illustrate the use of corpora in language learn- 
ing and teaching, namely the Chambers-Rostand 
Corpus of Journalistic French (CRJF) (Chambers 
& Rostand, 2005). This consists of approximately 
one million words of journalistic French, 1723 
articles from Le Monde, L’Humanité and La 
Dépéche du Midi in 2002 and 2003, including a 
variety of articles from six rubrics, namely edito- 
rial, cultural, sports, national news, international 
news, and finance. 

The advantage of consulting a corpus, as op- 
posed to a dictionary, course book or grammar, 
is that it provides the learner with examples of 
language use, of the lexico-grammatical patterns 
associated with a word or phrase, what Sinclair 
terms the semantic prosody (Louw, 1993; Sinclair, 
2004). To illustrate the use of the journalistic 
corpus we will analyze some of the occurrences 
of the word question in the CRJF. In a study of 
the role of a specialist corpus in self-correction 
by learners of their written texts, O’Sullivan 
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and Chambers (2006) noted a number of errors 
in relation to this word, for example “demander 
une question” instead of “poser une question,” 
and “il y avait la question de” instead of “il a été 
question de.” While a small specialized corpus 
was used in that study to find answers to specific 
problems in texts on a similar subject, the aim 
here is to investigate how useful a journalistic 
corpus would be in providing examples of phrases 
including question in a variety of topical contexts. 
The CRJF contains 456 occurrences of the word, 
interestingly almost three times the 153 occur- 
rences of the cognate English word “question” in 
the journalistic subcorpus of BNC Baby, which 
is approximately similar in size to the CRJF. The 
concordancer used in this study is Wordsmith 
Tools (Scott, 2004). 

Itis important to note that this analysis of some 
of the occurrences of question aims to provide 
examples of the use of the word for language 
learners. Given the small size of the corpus, it 
does not claim to be a study of the use of question 
in French journalistic discourse in general. Aston 
(2001) notes the importance of this distinction 
when using small corpora for language-learning 
purposes (p.75). In 249 occurrences question is 
preceded by the definite article. In 126 of these 
it is followed by de, de la, du, de 1,’ or des anda 
noun, while in only four cases it is followed by 
a verbal phrase. While a small number of these 
126 occurrences (3) refer to a geographical area 
to highlight a political issue (“la question du Chy- 
pre,” “la question de l’enclave de Kaliningrad,” “la 
question du Proche-Orient”), the majority refer 
explicitly to social and political issues: 


. La question de la laicité a ressurgi en jan- 
vier 

° Viennent s’y ajouter la question de l’emploi, 
la montée du ch6mage 

. Ce sera au gouvernement de trancher sur la 
question des retraites complémentaires 

. Chacun verra alors que la question des 
retraites n’est pas réglée 


. The corpus also includes 43 occurrences 
of question followed by an adjective. Geo- 
graphical and explicit social/political refer- 
ences are also common here: 

° la question corse, occitane, européenne, 
irakienne (5), nord-coréenne, palestinienne, 
proche-orientale, vénézuelienne 

° la question éducative, institutionnelle, nu- 
cléaire, raciale, salariale 


In another group of occurrences, the adjective 
serves to underline the importance of the ques- 
tion: seule (6), fondamentale (5), lancinante (3), 
centrale (2), essentielle (2), majeure (2), vraie 
(2), véritable, primordiale, cruciale, importante, 
grave. Examples include: 


. Celam’a déculpabilisé aussi. Autre question 
fondamentale : d’ou vous vient ce 

° Tout le monde est confronté a cette question 
majeure : que fait-on aprés le génocide 

. Trente-huit pour cent des accidents mortels, 
et la cruciale question des nombreux points 
noirs 

. nila grave et lancinante question du chomage 
(30%) 

. osons la seule question qui hante tout le 
monde 

. La vraie question est celle de notre systéme 
d’alerte 


It is important to note that seule does not only 
indicate the importance of the question, but, in 
two occurrences, refers to the limitation of the 
question to one specific issue: 


° Le discours tend a se réduire a la seule ques- 
tion scolaire 

° Une législation qui irait au-dela de la seule 
question du port du voile islamique 


Questions can also be délicates (3), trés sen- 


sibles, lassantes, simples, totalement secondaires, 
or even non-dites. The corpus thus provides 
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genuine examples of the use of question in texts 
on topical issues related to France, and to social 
and political issues of international interest. The 
register is relatively formal, and the phrases could 
be used in academic writing by learners, particu- 
larly in writing on topical issues, or in discussions 
of social and political issues. 

The study of the verbs used with question 
also reveals a variety of phrases belonging to 
this relatively formal register. Collocations with 
ETRE and Poser are immediately evident. The 103 
collocations with £rre (omitting the use of the 
verb to form the past tense of other verbs) can 
be divided into five categories, with variations 
on the phrase “il est question de” occurring 54 
times (See Table 1). 

The expressions with “il est question de” reveal 
how the concordance can provide a richer variety 
of examples than course books and grammars, in 
this case providing a variety of tenses and adverbs 
which occur with the expression: 
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. C’est d’une politique a l'économie qu’il est 
question 

° I] était aussi fortement question des condi- 
tions de travail 

° un article de Paris Match ot il était question 
de la vie sentimentale du joueur 

. Il a été beaucoup question de cicatrices a 
panser 

° Il n’a jamais été question de boycotter le 
bac 

° Il fut également beaucoup question d’identité 
et de pluralité culturelle 

. Il fut d’abord question d’y installer une sortie 
du métro 

. Il devrait également étre question, dans les 
discussions, de Chypre 

° Parce qu’il ne saurait étre question de faire 
mentir le Président 

. Jacques Chirac a réaffirmeé qu'il n’était pas 
question d’augmenter les impdts 

¢ La nouvelle Afrique du Sud: » il n’y est 
pas question de réconciliation et d’unité 


° Il est déja question de la gréve illimitée nationale 
Table 1. Question + ETRE 
Expressions Occurrences 
(negative) 
Il + Erre + question de 54 (34) 
Ce + Erre + une question de 14 (3) 
La question + Erre 14 (1) 
La question + Erre + de 10 (3) 
Il + Erre + hors de question 4 
Others 7 
Total 103 
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° Au Stade de France. « I] n’est pas question 
qu’un joueur dispute les trois rencontres 


The collocation of question and poser is also 
evident in the journalistic corpus, with 58 occur- 
rences in all, of which 12 are listed here: 


. Comme personne ne lui posait de question 
a ce sujet, il s’est chargé lui-méme de 

. Au moment méme oli se pose la délicate 
question du nucléaire 

. Je me suis posé la question de savoir ce que 
javais mal fait 

. La qualité d’Arsenal. Se pose-t-on la ques- 
tion de savoir si le Bayern est un grand 

. Posons ainsi la question : le climat change- 
til? 

. Un bain de sang. Pouvait-il faire autrement ? 
La question reste posée 

¢ _Unautre monde est-il possible ? la question 
se pose depuis la nuit des siécles 

° Ne serait-ce pas l’occasion de poser la ques- 
tion ? 

. Le maintien en détention provisoire pose 
également question. 

. Tout cela pose aujourd’ hui la question : que 
reste-t-il de nos amours 

. Ce batiment gigantesque posait évidem- 
ment la question de la consommation en 
énergie 

. Metaleurop est devenue par la force des 
choses un drame national, car il pose la 
question d’une réglementation pour éviter 
une telle catastrophe 


The last four examples above perhaps help to 
explain why the CRJF has almost three times as 
many occurrences of question as the journalistic 
subcorpus in BNC Baby. The English equivalent 
of those expressions is not “to ask the question,” 
but rather “to raise an issue.” The corpus also 
includes examples of expressions with question 
used with other verbs, albeit less frequently 
than with érre and poser, such as REPoNDRE (10), 


REGLER (7), REMETTRE EN QUESTION (6), SE PENCHER 
SUR LA QUESTION (4), ELUDER (3), ABORDER (2), and 
RESSURGIR (2). These examples illustrate an aspect 
of corpus consultation which corresponds to Ellis’s 
(2002) recommendation, quoted above, that what 
learners need is “mindful repetition” (p.177). In 
addition, the learner, consulting the corpus with 
a specific intention, or preparing for spoken or 
written communication, plays a much more ac- 
tive and analytical role than a learner repeating 
a phrase in a laboratory or reading an entry in 
a grammar. 

The analysis of the occurrences of question 
has so far illustrated the relatively formal nature 
of journalistic discourse, which, if it were a con- 
sistent characteristic, would make direct corpus 
consultation by learners a fairly straightforward 
activity. They could be confident that the lexico- 
grammatical patterns which they encountered 
could be used in presentations and essays as part 
of their studies of French-speaking countries. In 
analyzing one recurring pattern in the CRJF, 
however, the variety of registers which one en- 
counters in a corpus of journalistic discourse is 
highlighted. Consulting the concordance of pas 
question (55 occurrences), the learner will discover 
that 31 of these occur without £TrE, in other words 
representing a much less formal register than the 
examples discovered so far. Examples include: 


. Car la République est plongée dans le chaos 
et la discorde. Mais ici, pas question de de- 
scendre dans la rue en brandissant slogans 

. De la majorité de se montrer trés disciplinés 
lors de l'examen du budget. Pas question de 
toucher a l'architecture du projet de loi 

° Si elle constitue une entrave a la circulation 
des piétons. Pas question, non plus, de boire 
de l'alcool en dehors des lieux autorisés. 

. La question de la compétitivité est fonda- 
mentale assure-t-il. Selon lui, pas question 
de changer de cap malgré une économie en 
panne, au contraire 
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These do not belong to the relatively formal 
discourse which the analysis of occurrences of 
question has revealed until now. Nine of the 31 
occurrences are in quotation marks, while the 
remaining 22 are used by journalists in all three 
newspapers as a means of emphasis, often of 
conveying the strongly held views of the person 
whose views they are reporting. While there are 
816 occurrences of question in the Chambers Le 
Baron Corpus of Research Articles in French (this 
corpus will be deposited with the Oxford Text 
Archive), “pas question” occurs only six times, 
and only once without a verb. This suggests that 
this is not acommon feature of academic writing 
in French and it is unlikely that teachers would 
welcome the use of the phrase inthis way in student 
writing. Encountering it in the journalistic corpus 
could, however, encourage them to “notice” the 
use of the phrase in journalism or spoken by native 
or expert speakers of French, using “noticing” in 
the sense in which Schmidt (1993, p.217) employs 
the term in the context of language learning. The 
teacher’s role as mediator is thus crucial here, 
encouraging a critical approach both to corpus 
data and to the features acceptable in different 
genres on the part of advanced learners. As it is 
likely that language learners will be required to 
read and produce texts in different genres in their 
future lives and careers, corpus consultation can 
thus contribute to an important aspect of language 
learning as discourse analysis. 

In addition to the use of the corpus as a source 
of examples of expressions in French at various 
levels of formality, it can also provide the op- 
portunity for other linguistic discoveries, what 
Johns (1988) and Bernardini (2000) describe as 
serendipity, discoveries which the learner had not 
been looking for. The CRJF includes one refer- 
ence to “the question.” As is often the case in 
corpus analysis, the learner will need to consult 
the original text in full to investigate the reason 
for the use of English here. 

David Kelly n’est qu’une victime de plus, qui 
s’ajoute aux milliers d’Irakiens écrasés sous les 
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bombes et aujourd’ hui aux soldats d’occupation, 
nouvelles cibles d’une guerre qui n’en finit pas. 
Quand donc Bush et Blair vont-ils payer le prix 
de leurs forfaitures. That is the question. 

Why does the journalist not write, like oth- 
ers in the corpus, “la question se pose,” or “la 
question reste posée.” Robert (2006) examines 
the use of foreign words in French, namely niet 
instead of non and yes for oui. He describes niet 
as an absolute no, and yes as an enthusiastic form 
of the affirmative. In our example the English 
phrase is also used to add emphasis. The choice 
of Shakespeare is perhaps also influenced by the 
English context of the article. In summary, this 
examination of the occurrences of question in a 
journalistic corpus reveals how it can be a source 
of the type of formal language which a student 
might use in writing exercises, but can also 
include expressions which would be inappropri- 
ate. It provides a rich source of information for 
a learner about language use, but also demands 
an investigative and analytical approach to target 
language use by the learner. 


PEDAGOGIC APPLICATIONS 


Asis often the case in computer-assisted language 
learning, the teacher, far from being absent, plays 
an important role as mediator between the learner 
and the corpus. The question thus arises as to 
how these corpus data can best be presented to 
the learner, and how the teacher can guide and 
facilitate student learning from corpora. As we 
have seen, a number of published studies reveal 
that some of the learners given access to corpora 
find the analysis tedious and laborious. An initial 
encounter with concordance printouts prepared by 
the teacher is an obvious starting point, providing 
them with experience of analyzing data ona lim- 
ited scale. Using a 10-point font, approximately 50 
concordance lines will fit on an A4 page. Most of 
the 54 occurrences of “Il + £TRE+ question” could 
therefore be provided as a handout, as could the 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


Sharing Corpus Resources in Language Learning 


majority of the collocations of question + PosER, 
allowing the learners to discover the patterns 
which exist. Well-known examples of this type 
of activity include Tim Johns’s Web site, where 
the search word is omitted to create exercises, 
using both monolingual and parallel corpora. 
While McEnery and Wilson (1997) note that this 
indirect consultation is already a form of “active 
participation in the process of learning” (p. 6), 
it is nonetheless limited, leaving a significant 
amount of control with the teacher. Among other 
limitations, it excludes the possibility of check- 
ing the context of individual concordance lines, 
which, as we have seen, plays an important role 
in developing an awareness of variations within 
one broad category of discourse. Despite these 
limitations, this indirect consultation is easy to 
implement as an innovation in language learning 
and teaching, since even a teacher with no expert 
knowledge of corpora and concordancing could 
use Web-based examples and exercises prepared 
by others. This simple application is therefore 
perhaps the most likely to pass into general use 
among language teachers and learners. 

As we have already seen in Section 2, studies 
of direct corpus consultation by learners have been 
steadily increasing since the early 1990s, provid- 
ing considerable guidance to teachers who wish to 
encourage their learners to consult corpus data as 
part of the language-learning process. Kennedy 
and Miceli (2001), in particular, provide advice 
on how to train learners in corpus analysis and 
tips on ways of fine-tuning their searches to find 
answers to the problems they encounter. Once 
such training has been provided, teachers can 
recommend corpus consultation as a means of 
correcting errors or solving problems. As early as 
1986, Johns mentioned experimenting with plac- 
ing Cin the margin of student work torecommend 
corpus consultation, but since then no framework 
has been developed for the development of direct 
corpus consultation by learners. In the case of 
the above analysis of question, for example, a 


learner writing “demander une question” could 
be advised to search for question in a corpus 
such as the CRJF. The absence of collocations 
with DEMANDER and the prevalence of those with 
PoseR would quickly provide the answer. All this, 
however, presupposes easy access to suitable 
corpora and concordancing software, as well as 
to training in the choice of corpus, the use of the 
software, and analytical techniques. 


CONCLUSION: A FRAMEWORK 
FOR CREATING, SHARING AND 
USING RESOURCES 


The research questions identified at the start of the 
chapter concerned the optimal conditions firstly 
forthe creation and sharing of resources, secondly 
for the learners to benefit from consulting them, 
and thirdly for the integration of corpus consul- 
tation in the language-learning environment. A 
useful starting point for proposing a framework for 
developments in this area is perhaps Fligelstone’s 
(1993) futuristic scenario, quoted earlier. When 
the learners follow the teacher’s advice to “go to 
any of the labs, hit the icon which says ‘corpus’ 
and follow the instructions on the screen” (p.101), 
what type of resources and tools would they need 
to see on that screen? Corpora and concordancers 
is the simple answer, but the situation is clearly 
more complex, as the availability of many corpora 
anda significant number of concordancers has not 
led to widespread use of concordancing by learn- 
ers. Firstly it is important to note that the implied 
context of the scenario involves independent 
study rather than classroom-based learning, so 
this context will be assumed in what follows. It 
is clearly a more realistic option than expecting 
all university language teachers to acquire the 
necessary expertise. In our framework informa- 
tion would be provided in six areas, corresponding 
to the icons which would confront Fligelstone’s 
imaginary learners and their teachers: 
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. Introduction to corpora 

. Corpus-based learning and teaching materi- 
als 

° Concordancers 

° Language resources 

: Creating corpora 

. Advice for teachers 


The resources to be shared would thus not only 
include the corpora, but also online training on 
how to obtain and analyze data, and advice on 
creating corpora or extracting appropriate corpora 
from existing larger corpora. As we shall see, 
some of the preparatory work underpinning the 
implementation of this framework already exists, 
but has yet to be tailored specifically to the needs 
of the learner. 

Introductory texts on corpora are readily 
available on the Web, in some cases specifically 
written for learners, such as Catherine Ball’s 
Tutorial: Concordances and corpora, although 
such resources are not always regularly updated. 
Individual universities could thus easily incorpo- 
rate these into a brief introductory text tailored 
to the needs of their own learners. For learners 
who choose not to consult corpora directly, links 
to ready-made resources based on general and 
specialized corpora could provide large numbers 
of learners with access to corpus data. Many 
learners might, however, wish to continue on 
to direct corpus consultation. To the best of our 
knowledge, online training programs on the use 
of concordancing software are not available for 
any of the packages currently on offer, with the 
result that individual institutions would have to 
create their own, or provide training in labora- 
tory sessions, as has been the case in the studies 
quoted in this chapter. 

Providing learners with corpora specially 
tailored to their needs is the greatest challenge, 
particularly in languages other than English. 
While Web sites with links to available corpora 
categorized by language already exist, such as 
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the University of Tiibingen’s Corpora site, they 
cannot succeed on their own in providing access 
to corpora for language learners whose teachers 
are neither experts nor enthusiasts. Yet, given the 
factthatuniversity language studies have muchin 
common, there is clearly considerable potential for 
sharing resources. A student of French studying 
the written and spoken language, nineteenth-cen- 
tury literature and post-war French politics in a 
given semester, forexample, could be given access 
to every day language in the form of a corpus of 
journalistic texts such as the CRJF, and a freely 
available spoken corpus suchas Beeching’s corpus 
of spoken French. Inaddition, access to specialized 
resources could be provided, such as a corpus of 
academic writing in French, corpora of the works 
of relevant authors (see, forexample, Maupassant 
pas les textes, which is available on the Web), and 
corpora of political discourse, if such resources 
could be identified or created. Similarly, students 
of Business Studies and languages, a popular 
combination in many universities, would be given 
access to corpora of everyday language, as well 
as to relevant specialized spoken and written 
corpora. Resources relevant to other disciplines 
which combine with languages, such as law and 
several science subjects, would also have to be 
made available within this framework. 
Specialized corpora which represent a particu- 
lar text type or genre can be created by extracting 
relevant texts from a larger, more general corpus, 
or by constructing a corpus from documents found 
elsewhere. An advantage of reusing texts from a 
corpus is that the texts are likely to already be in 
a suitable format with appropriate markup and 
useful documentation. However, if these formats 
are not already in the required format, or contain 
annotations which are not needed, then some 
difficult processing may be necessary to convert 
the texts. There can be several advantages to be 
gained by finding texts from elsewhere. Searching 
the web and other sources of electronic texts (or 
even printed or other materials for digitization) 
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offers a far larger source of potential texts, and 
thus many more possibilities for a wider range of 
sampling and for different types of corpus. It is 
also possible to obtain texts which are more up 
to date, since the process of building and making 
available a corpus typically takes several years, 
and so the texts in an existing corpus are likely 
to be older than those available elsewhere. In 
either case, care should be taken to take note of 
the license conditions under which materials are 
made available, if any, and to take good advice on 
copyright issues, which may be complex. 

Finally, the resources to be shared would 
include advice for teachers and language advi- 
sors, ranging from the limited form of corpus 
consultation represented by using corpus-based 
materials created by others, to advice on encour- 
aging learners to explore the corpora themselves. 
Once again, some general resources in this area 
already exist, such as ICT4LT, a set of online 
training modules in ICT for language teachers, 
including two modules on corpora and con- 
cordancing. Support systems also exist where 
corpora are consulted to respond to queries from 
language teachers relating to current language use. 
Tsui (2004) describes a Web-based resource for 
English language teachers in Hong Kong, which 
could serve as a model for developments in other 
languages. Teachers’ queries are addressed by 
their peers and by specialists who have access 
to corpus data. 

In conclusion, each of the categories in the 
framework would require much more detailed 
planning than is possible in this study. Although 
some of the resources mentioned already exist, a 
very considerable number do not, with the result 
that the above description can be seen as a “wish 
list,” to borrow R6émer’s (2006) term. In the case 
of corpora, for example, only monolingual written 
and spoken corpora are referred to above. Other 
corpora suitable for language learners include 
learner corpora, nonnative speaker corpora, paral- 
lel corpora, and multimodal corpora. Although 


the availability of such corpora is very limited, 
a number of publications investigate their use in 
the language-learning context (Granger, Hung 
& Petch-Tyson, 2003; Pearson, 2003; Seidlhofer, 
2000). Despite this, it is clear that many of the 
resources required already exist and could be 
shared, and that meeting the needs of learners 
and teachers would not represent for an individual 
institution the mammoth task that the above de- 
scription might suggest. 
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KEY TERMS 


Annotation (see Markup) 


Archive: A repository where materials which 
are considered to be of potential future value are 
deposited in a secure environment, where their 
ongoing viability may be monitored. In the case 
of electronic resources, suchas language corpora, 
a digital archive is required. Digital archives need 
to ensure the physical security of the data, which 
may be on a variety of media such as magnetic 
tape, removable disks, computer disk drives, 
and need to provide robust backup and disaster 
recovery facilities. It is also necessary that the 
curation of the data involves ensuring that it is 
stored in formats which are usable with current 
software. 


Collocation: The tendency of certain words to 
occur more frequently in the vicinity of particular 
words in texts. For example, ‘rancid’ tends to oc- 
cur with ‘butter’ 


Concordance: A list of the occurrences of a 
word (or other search term), presented one per 
line along with the immediate surrounding text, 
inorder to display forthe analyst a set of examples 
of the usage of a word, and to enable patterns 
of usage surrounding the word to be observed. 
Concordances may be produced by a piece of 
software known as a concordancer. 


Corpus: A collection of naturally occurring 
data collected for the purpose of a linguistic 
investigation. A corpus may include materials 
representing various modes, registers and text 
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types, and it may be possible to isolate these subsets 
of data, and analyze them separately or contrast 
them. Such a subdivision of a corpus is known 
as a subcorpus. A parallel corpus contains texts 
and translations of those texts, and is compiled in 
order to analyze and study translations. 


Markup: In the form of tags in a text, is used 
to add information about the structure of a text 
and about its linguistic properties. Markup may be 
used to indicate such structural features as titles 
and headings, paragraph boundaries, highlighted 
text, and linguistic features such as lemmas and 
word classes. Linguistic information which has 
been added to a corpus in the form of tags is often 
known as annotation. 


Metadata: In corpus linguistics, the informa- 
tion about a corpus and about the constituent texts 
is known as metadata. Metadata will typically 
include information about when and by whom a 
corpus was created, the sampling strategy which 
was applied to compile the corpus, and informa- 
tion about the texts in the corpus, such as title, 
author and date of publication. Metadata may be in 
separate documentation files, or may be inserted 
in the corpus text files in the form of headers. 


Text Encoding: Text may be captured in elec- 
tronic form in various ways. Electronic texts are 
stored in the form of binary data, and will make 
use of some form of mapping from the binary 
codes to characters in the language. In the past, 
various competing standards have existed, with 
different mappings for different languages and 
on different computer systems. There is now an 
international standard, Unicode, which aims to 
represent all characters in all languages, and be 
usable on all computer systems. Not all corpora 
use Unicode, and not all software applications 
currently make use of it, so difficulties may arise 
when attempting to share language data. 
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Chapter XXVI 
The Texture of Inefficiently 
Self—Regulating ESL Systems 


Terence Patrick Murphy 
Yonsei University, Korea 


ABSTRACT 


This chapter addresses the question of how to measure the student’s English as a second language (ESL) 
textual sophistication. It suggests that the second language text is an inefficiently self-regulating system, 


at the levels of grammar, lexis and logico-rhetorical structure. Learner texts use a narrow or even fixed 
set of key lexical phrases; they deploy cohesive ties that bind the text incorrectly, they omit cohesive ties 
altogether, or redundantly retain items that are easily recovered from the situational context. Follow- 
ing a review of some typical second language cohesion problems, the chapter offers an analysis of the 
emergent texture of four versions of the same paper, each written by a different ESL student. The results 
suggest that a learner text-maker is unable to perceive the ineffective choices in texts written at levels 
of sophistication higher than those he or she is capable of creating. 


INTRODUCTION 


In the last 10 years, the investigation of the writ- 
ten texts of English as a second language (ESL) 
learners has turned increasingly to the use of 
computer-aided corpus analysis (De Beaugrande, 
1997; Freedman, Pringle & Yalden, 1979; Reid, 
1992; Granger, 2002; Kroll, 1990; Yoon & Hirvela, 
2004). Since it is strongly committed to the ac- 
ceptance of the evidence found in large sources 


of natural format data, corpus research offers a 
means for establishing Robert De Beaugrande’s 
triumvirate of normal science attributes at the 
heart of second language acquisition research: 
convergence, consensus, and coverage (De Beau- 
grande, 1997; Sinclair, 1991). One major initial 
concern within this new field of study has been 
the issue of how to measure the student’s grow- 
ing ESL sophistication. To date, a majority of 
the applied linguists who have investigated this 
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issue believe that an adequate explanation must 
focus predominantly on some notion of lexical 
richness (Laufer, 2005; Laufer & Nation, 1998; 
Meara, 2005; Shaw & Liu, 1998; Wolfe-Quintero, 
Inagaki & Kim, 1998). In this chapter, however, 
I will argue that an exclusive focus on lexis of- 
fers an oversimplified account of the ability of 
the second language writer to produce written 
English texts. As an alternative, I will suggest 
that applied linguists need to offer a three-fold 
account of second language textual development, 
one that incorporates grammar, lexis and logico- 
rhetorical structure. 


THE TEXT ASA 
SELF-REGULATING SYSTEM 


A well-written text may be defined as a self-regu- 
lating system. The well-written text exhibits an 
informational dialectic of ease and efficiency ina 
register appropriate for the situational context (De 
Beaugrande, 1980; Iser, 1978). As a self-regulat- 
ing system, the well-written text provides a set of 
directives to enable the reader to probe a variety 
of intra-textual (and extra-textual) relations to a 
certain depth at distinct grammatical, lexical and 
logico-rhetorical levels, without giving rise to 
insoluble discrepancies, paradoxes, ambiguities, 
or contradictions (De Beaugrande, 1980; Murphy, 
2005a). If the texts of ESL students are considered 
as a special case of the more general category 
of the poorly written text, what this means is 
that the typical learner text is inefficiently self- 
regulating. One of the major reasons why this is 
so is because the second language text possess 
emergent texture (Murphy, 2001). In other words, 
because the grammatical, lexical and logico-rhe- 
torical relations in the second language text remain 
underdeveloped, many of its textual directives 
lead to ambiguities, discrepancies, paradoxes, 
contradictions and redundancies. Particularly for 
those readers who have had limited experience 
working with learner texts, the result is frequently 
frustration and confusion. 
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THE MURPHY-LEE SECOND 
LANGUAGE CORPUS 


The Murphy-Lee Second Language Corpus is a 
personal collection of Korean English-language 
learner texts that I have been assembling with 
the assistance of my wife, Lee Joon-kyoung, in 
the Department of English at Yonsei University 
in Seoul, Korea since 1999. As of Fall, 2006, 
the total word count is approximately 100,000 
words, with the corpus increasing at the rate of 
about 15,000 words per year. Although the cor- 
pus contains the work by students in a number 
of different humanities departments at the uni- 
versity, the bulk of the material is by students in 
the English department. For the past five years, I 
have focused on the collection of five-paragraph 
essays. All of the five-paragraph essays in the 
corpus include at least one revision; many of them 
include two. These essays are of two principal 
types: discussions of movie themes and literary 
interpretation of short stories, mostly by James 
Joyce. However, there are also a number of other 
genres represented in the corpus, including about 
120 single paragraphs as well as an increasing 
number of graduate-level summaries and critiques 
of published linguistics papers. In addition, asmall 
set of assignments have involved the revision of 
a low-level learner text. These last assignments 
were undertaken as part of aone-week take-home 
end-of-term examination. 


LEXIS OR GRAMMAR? 


In the Hallidayean account of English grammar, 
the formation of the five key word groups—the 
nominal group, the verbal group, the adverbial 
group, the adjectival group, and the prepositional 
group—involves the text-maker in simultaneous 
grammatical and lexical word choices. The gram- 
matical items consist of that set of words involved 
in asmall fixed number of obligatory choices. As 
Halliday, McIntosh, and Strevens (1964) suggest: 
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“There are some places in every language where 
we have to make such choices; we cannot avoid 
them or remain neutral, and there is a limited 
number of possibilities to choose from” (p. 21). 
For example, in English, there is the obligatory 
choice between this and that; or the obligatory 
choice among who, whose, what, and which; the 
obligatory choice between the use of the singular 
and the plural; the obligatory choice between the 
use of the present or another tense; and the choice 
between the positive and negative use of language 
items. This first set of words consists of those 
language items where “we face a choice among 
a very small number of possibilities” (Halliday, 
McIntosh, & Strevens, 1964, p. 21). In contrast, 
lexis refers to language events where meaningful 
choice involves “a very large number of possi- 
bilities” and where it is very difficult to separate 
out “what is possible from what is impossible” 
(Halliday et al.,1964, p. 21). 

The second language text-maker’s task thus 
unfolds on at least three different levels. More- 
over, each of these three levels appears to develop 
not simultaneously but rather unevenly. In other 
words, grammar, lexis, and logico-rhetorical 
structure present the second language text-maker 
with different kinds of difficulty. Indeed, for Ko- 
rean learners for whom the mastery of the article 
system is a life-long undertaking, it may be that 
lexical collocation is not necessarily the most dif- 
ficult among these tasks (But cf. Wray, 2002). If 
this is so, a measure of lexical sophistication will 
not be the most accurate means for determining 
a text-maker’s second language development, as 
supporters of the concept of the lexical frequency 
profile would maintain (Laufer, 2005; Laufer & 
Nation, 1998). A more sensitive measure, it is 
suggested, is the development of that aspect of 
the learner’s ESL grammar that is involved in the 
formation of texture. 


THE COHESIVE TIES AND 
EMERGENT TEXTURE 


Textual cohesion is established by means of the 
five major forms of cohesive tie. The first four 
sets are the ties of reference, substitution, ellipsis 
and conjunction (Halliday & Hasan, 1976, p. 4). 
A central measure of the text-maker’s language 
abilities is therefore the ease with which he or 
she can deploy the full range of ties. In contrast, 
a limited ability on the part of the text-maker to 
form some or all of these ties restricts the learner’s 
text-making abilities. According to Halliday and 
Hasan (1976), “a text has texture, and this is what 
distinguishes it from something that is not a text. 
It derives this texture from that fact that it func- 
tions as a unity with respect to its environment” 
(p. 2). If competent first language texts exhibit 
texture, learner texts possess a differentiated 
range of emergent textures. At one extreme, 
examples exist of virtually unreadable second 
language texts. These texts are presumably created 
with almost no consideration at all for grammar, 
lexis and logico-rhetorical structure. The textual 
relationships among their clauses, sentences, text 
segments and the text are therefore sometimes 
unrecoverable: 


In our society, sex merchandising come in touch 
with the prosperity of merrymaking place that try 
conclusions by barmaids’s nude service. the ‘Boss 
landing operations’ uncovered the merrymaking 
culture frankly. the sticky scenery ofmerrymaking 
place shield the subject of this comic movie that 
a public prosecutor confront with gang. 


This first example is so obscure that I have 
begun to suspect that it may have been produced 
by the automatic translation of an original Korean 
textinto English, using the freely available Internet 
program, Babelfish. Ifthis is the case, the inability 
of the student to recognize the incoherence of 
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the translated text is evidence of a very low ESL 
ability. In this example, it is virtually impossible 
to reconstruct the intended meaning of the text- 
maker. It is clear that the subject of the text is a 
comic movie, which is apparently entitled ‘Boss 
Landing Operations.’ The movie seems to be 
about a public prosecutor who is in conflict with 
a criminal gang. For reasons that are obscure, 
the movie is representative of a society in which 
sex has become commercialized. Beyond this, it 
is difficult to say much more. The text-maker’s 
inability to recognize that he has presented a 
virtually incomprehensible text is strong evidence 
of a very low second language ability. Near the 
middle of this continuum, readable texts with 
highly unusual wording occur. These texts also 
occasionally incorrectly signal the relations among 
the word groups, clauses and sentences in a way 
that is initially confusing: 


People sometimes want to have inner resources 
and so do I. All That Jazz—the jazz bar which 
is located in Itaewon is my favorite bar for that 
reason. There is a wooden stair which leads to 
the bar, because it is upstairs. Old jazz musicians 
pictures are hung on the both side of the stairway. 
End of the stairway, there is a door which moved 
slightly by the jazz harmony. 


In the first sentence, “People sometimes 
want to have .. the 
Googled choice of the next two words includes 
such items as a baby or a relationship or a scrap 
or more fun. For Halliday, what this means is that 
“lexis seems to require the recognition merely of 
linear coexistence together with some measure 
of significant proximity, either a scale or at least 
a cut-off point” (Halliday, 1966, p. 152). Theo- 
retically, of course, the level of individual word 
detail required to specify such a measure could 
be written down ina sufficiently large dictionary. 
As Halliday (1966) suggests: 
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No grammar has, it is believed, achieved the 
degree of delicacy required for the reduction of 
all such items to one-member classes, although 
provided the model can effectively handle cross- 
classifications, itis by no means absurd to see this 
as the eventual aim: that is, a unique description 
for each item by its assignment to a ‘microclass,’ 
which represents its value as the product of the 
intersection of a large number of classificatory 
dimensions (p. 149). 


It is Halliday’s idea of significant proximity or 
collocation that the first language writer draws on 
when he or she intuitively recognizes, as asecond 
language writer may not, that the class of items 
that can successfully conclude a sentence like: 


People sometimes want to have 


does not include the unusual second language 
lexical collocation inner resources. Finally, there 
are those learner texts that employ mostly correct 
phrasing and clause structure. In this sense, these 
learner texts are barely distinguishable from the 
sophisticated self-regulating systems produced 
by first language writers: 


Jae-na is a nice girl, but she is so shy that she 
cannot speak to an audience well. Because of her 
timidity, a pink glow often mounts her cheeks. Her 
personality influences on her style of clothing. 
She likes clothes which expose her body little. 
Because she wants not to attract public attention, 
she wears dark-colored garments. 


The major difference between first language 
texts and this second language text is the latter’s 
limited ability to deploy a sophisticated lexical 
repertoire. As a result, it has a somewhat sopho- 
moric quality to it. 
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METHODOLOGY: MARKEDNESS 
AND EMERGENT TEXTURE 


A large number of problems relating to the inef- 
ficient cohesion achieved by ESL texts appear 
to be related to the text-maker’s selection of the 
unmarked, rather than the marked, textual option 
(Murphy, 2001). In other words, the text-maker 
apparently does not understand the textual mo- 
tivation that lies behind the choice of the marked 
term. As a result, many learner texts consist of 
what reads like a series of discrete sentences 
rather than being unified textual products tied 
together with the appropriate cohesive devices. 
In learner texts, the inability to plan prospec- 
tively (or, more rarely, to plan retrospectively) 
means the text may falter at the level of the next 
prepositional phrase or the next sentence or the 
next discrete text segment. For example, in the 
following example, the learner text-maker begins 
with acontext-specifying prepositional phrase but 
then follows this repeatedly with the unmarked 
form of the definite article: 


For example, in “Notting Hill,” a main woman 
character is the famous actress in Hollywood but 
amainman character is 35-year-old divorcee who 
runs a travel bookstore in Notting Hill, London. 
In “Pretty Woman,” a man is a rich businessman 
who visits Hollywood on business but a woman 
is a Street girl. 


As Halliday and Hasan (1976) write, “the 
definite article ... merely indicates that the item 
in question IS specific and identifiable; that some- 
where the information necessary for identifying it 
is recoverable” (p. 71). In the sample learner text, 
although the learner text-maker has signaled that 
the information is specific (in “Notting Hill” ... 
in “Pretty Woman”), she does not coordinate this 
logico-rhetorical structure with the choice of the 
definite article. The next example demonstrates 
the tendency of the learner text-maker to favor 
the unmarked or non-selective it (instead of the 


marked cohesive this) in the signaling of refer- 
ence continuity: 


It’s free to enter and exit, but if students check out 
library materials without appropriate steps and 
permission, it will be detected by book detection 
system and students will be punished according 
to the regulations. 


Learner text-makers also tend to rely on the 
neutral non-selective definite article the (rather 
than the cohesive demonstrative this) in estab- 
lishing reference back to a previously mentioned 
lexical item: 


In front of the door or the counter, sofas are put 
from left to right facing a large screen which dis- 
plays all sorts of rock music clips. On the screen 
you can see several genre clips that are from USA, 
Japan, Europe and even the Third World. 


The learner text-maker may also demonstrate 
confusion in choosing the appropriate cohesive 
device: 


In addition when they shall be old, they want to 
live with son’s family and take it for granted that 
son should support their old parents. They rarely 
expect daughters to do so for their parents. 


This final example may suggest that the various 
forms of cohesive substitution—nominal, verbal, 
and clausal—represent a hierarchy of grammatical 
difficulty. In this regard, Jo Soo-jin, one of my 
former graduate students, has observed that the 
instances of nominal substitution that occurred 
in a small 70-item sub-corpus of five-paragraph 
essays from the Murphy-Lee Corpus showed the 
single pattern of a/the + adjective + one(s) (Jo, 
2003). Without empirically verifying this, Jo posits 
the following learning order for the cohesive ties 
of substitution: nominal one, verbal do, nominal 
same, plural ones, clausal so, combined do so, 
and clausal not. 
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Lexical directives constitute the fifth set of 
cohesive ties. According to Halliday and Hasan 
(1976), “reiteration is a form of lexical cohesion 
which involves the repetition of a lexical item, at 
one end of the scale; the use of a general word to 
refer back to a lexical item, at the other end of the 
scale; andanumber of things in between—the use 
of a synonym, near-synonym, or superordinate 
(p. 278). Reiteration in low-level learner texts 
takes place at the end of the scale marked out by 
repetition. This form of cohesion involves simple 
lexical repetition and the neutral non-selective 
use of the definite article as an anaphoric device. 
In low-level learner texts, the tendency is for the 
text-maker to introduce a specific lexical item 
using the indefinite articles a or an and then to 
switch to the use of the non-selective definite ar- 
ticle, the (Murphy, 2001). It is also quite common 
in such texts for this kind of lexical repetition to 
take the simplest form of unadorned modifier 
and identical head. In other words, each of the 
other possible elements—numerative, epithet, 
classifier, thing and qualifier—remain unrealized 
(Murphy, 2001). The upshot of this is that second 
language texts are inefficient at the level of lexis. 
By relying on the use of exact lexical repetition 
to establish continuity of reference, these texts 
fail to take advantage either of the effort-saving 
substitution of appropriate pro-forms or of the 
appropriate curtailment of language items that 
are immediately recoverable from the situational 
context in establishing continuity of reference: 


Feminism is a movement of extension of women’s 
rights that were reduced in the past society of 
patriarchal system that man were believed to 
be superior to women. In other words, feminism 
movement is amovement for equality betweenmen 
and women. So, it is needed to try to know how 
women have been treated discriminately and how 
women try to be treated on the same footing as 
men. At first, we need to know how women have 
been treated at home (my emphasis). 


458 


In this second language text, the burden of 
establishing overall continuity of reference is 
presumably so great that little consideration is 
given to the high degree of redundant items that 
are presentin this text. The most appropriate frame 
of reference for this aspect of second language 
texture is the range of lexical choice in comparable 
first language texts. Consider, for example, the 
New York Times article entitled “Another Attack 
in Central Iraq Kills Another U.S. Soldier” (Rohde 
2003). In this first language text, a central chain 
of reference is grown out of the initial title refer- 
ence to “Another U.S. soldier”: 


American soldiers ... one American ... military 
Officials ... the third American soldier ... Five other 
American soldiers ... American commanders ... 
American forces... United States commanders... 
4,000 soldiers...a1,200-member armored cavalry 
squadron... Military commanders... the increased 
American presence ... American military might 
... American soldiers ... United States forces ... 
the new American approach...Adozen American 
soldiers... they... Americans ... American forces 

.. Soldiers ... officials from the Third Armored 
Cavalry Regiment ... Reinforcements ... military 
officials ... more American deaths ... American 
troops ... soldiers ... American troops ... their 
troops ... them ... American misconduct ... the 
American search 


Among the lexical choices in this newspaper 
text, there are superordinate items (American 
forces, American troops), synonyms (Ameri- 
can) and near-synonyms (American presence, 
American military might), as well as word items 
indicating a range of hierarchical (military com- 
manders, military officials) and horizontal rela- 
tions (officials from the Third Armored Cavalry 
Regiment, Reinforcements). These first language 
choices provide the most appropriate frame of 
reference for analyzing second language choices 
insimilar situational contexts. In contrast, here are 
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the textually established lexical ties in a learner 
text dealing with the subject of the U.S. military 
presence in Korea: 


the presence of U. S. military in Korea...the le- 
gitimacy of the U. S. military in Korea...the U.S. 
military in Korea...it...it...the presence of U. S. 
military in Korea...it the very U. S. military...the 
presence of U. S. military...the legitimacy of U. 
S. military in Korea...the U. S. military...the one 
in Korea...the U. S. military in Korea...the U. 
S. military in Korea...the U. S. military in the 
region...the U. S. military in Korea...the U. S. 
military in Korea...it in the Peninsula...the U. S. 
military in Korea...the U. S. military 


What these textual choices reveal is that at a 
certain level of sophistication learner text-makers 
demonstrate little or no ability to vary lexical refer- 
ence by means of synonyms and near-synonyms. 
In this text, the full collocation the U.S. military 
in Korea occurs ten times, the shorter collocation 
the U.S. military occurs four times, and the vari- 
ant the U.S. military in the region occurs once. 
Besides this, the learner text-maker is only able 
to vary this monotonous set unsteadily with the 
use of the pro-form it and the attempted use of 
the substitute one (Hwang, 2003). Learner texts, 
in other words, are inefficiently self-regulating 
systems. They are highly repetitive in their use of 
a narrow or even fixed set of key lexical phrases; 
they deploy cohesive ties that bind portions of 
the text incorrectly, they omit to deploy cohesive 
ties altogether, or else they redundantly retain 
items that are immediately recoverable from an 
established situational context. 


LOGICO-RHETORICAL STRUCTURE 


Within functional grammar, grammar and lexis 
are both well articulated concepts. These two 
concepts, however, do not exhaust the description 
of the self-regulating nature of textual systems. As 


Halliday (1994b) suggests, “a text has structure, 
but it is semantic structure, not grammatical. Just 
as a syllable has a phonological structure, and a 
clause has a grammatical structure, a text has a 
semantic structure.... For a text to be coherent it 
must be cohesive; but it must be more besides” (p. 
339). Textual coherence—that “more besides”—is 
established principally by the text’s deployment 
of a specific logico-rhetorical structure. The 
text’s logico-rhetorical structure is the work of 
the punctuation and a specific set of word items 
distinct from both the grammar and the lexis. 
Within Hallidayean grammar, the clause consists 
of two major elements: a given element and a new 
element. The given element is what the text-maker 
supposes the reader already to know, while the 
New Element is what the text-maker suggests 
the reader ought to find interesting or unusual or 
newsworthy. According to Halliday (1994a), “what 
constitutes the ‘main point’ of the discourse is any 
motif that figures regularly as New” (p. 146). The 
New element, which is realized “prosodically, 
by greatest pitch movement in the tone group” is 
what the writer suggests the reader is “to attend 
to” (1994a, p. 140). 

Well-written texts progressively accumulate 
information through a skilful deployment of the 
dialectic of moves and comments. Move clauses 
are used to drive the text forward, by picking up 
the new information that has previously been pre- 
sented and extending it in some way. In contrast, 
comment clauses purposefully slow down the 
rate of information presentation by elaborating a 
portion of the previous sentence’s given informa- 
tion, typically reaching back for that information 
with cohesive devices. Well-written texts skill- 
fully utilize this dialectic to drive toward clear 
textual goals. What is more, well-organized texts 
regularly utilize normal or typical or unmarked 
order to present their information, while reserv- 
ing the choice of unusual or untypical or marked 
order for special informational purposes. Poorly 
organized texts, on the other hand, present in- 
formation in the form of discrete text segments 
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but fail to relate the semantic meaning of these 
individual text segments to the overall textual 
goal. Poorly organized texts show only haphazard 
recognition of the fundamental dialectic of moves 
and comments. They work with formalistic no- 
tions of textual organization and overall textual 
meaning. 

The occasional incoherent stretches of infor- 
mation presentation in inefficiently organized 
texts result from the text-maker’s choice of a 
logico-rhetorical structure that does not facilitate 
accurate processing. Essentially, what badly orga- 
nized texts do is to use an inappropriate or poorly 
elaborated structure to signal the text’s main point. 
One way in which badly organized texts do this 
is by offering inappropriate Thematic signals for 
the information they haphazardly present as the 
main point of the text (cf. Fries, 1994; Halliday, 
1994a). In other words, what gets construed as the 
“main point” is often not really the main point at 
all. In poorly organized texts, the relations between 
the main and the subordinate information are 
confused. The text-maker often sidelines what 
ought to be central and erroneously highlights 
what ought to be peripheral. 

The founder of functional grammar has sug- 
gested that a written text represents a system of 
fixed sentence choices. In other words, in his 
theoretical writing, Michael Halliday haphazardly 
defends the view that choice at the level of the 
individual sentence in a given text is already op- 
timized. The reason that the founder of functional 
grammar suggests this is because he had not found 
a way to incorporate the notion of valid choice 
above the level of the sentence into his theory. 
However, it is more accurate and productive to 
suggest the following proposition: any written 
text exists as merely one among a number of pos- 
sible textualizations (Coulthard, 1994). In other 
words, the written text needs to be construed as 
a potential system for optimal information claus- 
ing. The concept of alternative textualization is 
important for all aspects of textual linguistics, 
but it has a particular significance within ESL 
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textual studies. This is because the ability to 
re-textualize or rewrite a poorly self-regulating 
learner text is one of the most significant tests of 
a learner’s second language ability. What makes 
this task possible is the recognition on the part 
of the text-maker of the possibility for deploying 
alternative logico-rhetorical structuring of the 
same information. 

What follows are four versions of the same 
text. The first text is the original, composed by a 
low-level second language text-maker. The sec- 
ond, third, and fourth are all rewritten versions 
composed by other students as part of an end- 
of-term one-week take-home examination for an 
intermediate English course at Yonsei University. 
The students inthe class were drawn from a variety 
of disciplines within the humanities, including 
law, dentistry and business administration. The 
second text has been composed by a second lan- 
guage text-maker of roughly comparable ability 
to that of the original text-maker; the third, by a 
mid-level second language text-maker; the fourth, 
by atext-maker whose language abilities approach 
that of a first language writer. 


Comparison and Contrast of Two Popular 
Movies 

The movie “Notting Hill” which was released in 
this summer can be compared to the movie “Pretty 
Woman” which was made in 1990. In first, a lead- 
ing actress is the same person, Julia Roberts. She 
was very proper and well-matched to the movies. 
Especially in “Notting Hill,” playing a role not too 
far removed from her own existence, Roberts gave 
an understated, nuanced performance. Besides, 
the basic structure of two movies’ story are very 
similar. Main characters who are different in social 
class and living circumstance meet accidentally 
and fallin love with each other. However, they have 
misunderstandings, conflicts, and obstacles in 
their love because they have lived in very different 
ways. So they break up. In spite of that, they meet 
againand certify their own love. Someone say that 
the movies are modern versions of ‘Cinderella.’ 
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Both of two movies show us love story which is 
hard to exist in real world. Though entire structure 
is very similar, the rest—occupation of character, 
background, and happenings—are very different. 
For example, in “Notting Hill,” a main woman 
character is the famous actress in Hollywood but 
amainman character is 35-year-old divorcee who 
runs a travel bookstore in Notting Hill, London. 
In “Pretty Woman,” a man is a rich businessman 
who visits Hollywood on business but a woman is 
a street girl. “Notting Hill” and “Pretty Woman” 
are similar and different 


In this low-level learner text, many of the 
language choices have not been optimized. For 
example, at the level of grammar, the text-maker 
makes such choices as “a leading actress,” “to 
the movies,” “their own love,” “Both of two 
movies,” “in [the] real world,” “a main woman 
character,” “a main man character,” “[a] 35-year- 
old divorcee,” “a man,” “a woman.” At the level 
of lexis and collocation, the text-maker utilizes 
such non-standard choices as “very proper and 
well-matched,” “certify their own love” and “hard 
to exist in the real world.” At the level of logico- 
rhetorical structure, the text-maker demonstrates 
a lack of ability to achieve overall textual unity. 
This is chiefly signaled by the utilization of the 
Thematically marked sequence, “The movie “Not- 
ting Hill” which was released in this summer 
can be compared to the movie “Pretty Woman” 
which was made in 1990. In first, ... Besides, ... 
Someone say that ... Though entire structure 
is very similar,....” In addition, the text-maker 
frequently end-focuses subordinate information: 
“which was made in 1990,” “because they have 
lived in very different ways” and “So they break 
up.” Indeed, the most glaring aspect of this more 
general problem is the three-sentence textsegment 
that deals with the acting ability of Julia Roberts. 
Finally, we might note that the self-regulating 
nature of the textual system itself is occasionally 
impaired. For example, whereas the reader must 
move forward in the text to discover that “the rest” 
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may be resolved as “occupation of character ... 
the famous actress ... 35-year-old divorcee who 
runs a travel bookstore ... a rich businessman 
...a Street girl” and as “background ... in Hol- 
lywood ... in Notting Hill, London,” the textual 
resolution of “happenings” requires a different 
strategy. The meaning of this lexical item must 
be resolved by either a backwards search to the 
language item “basic structure” or by appeal to the 
reader’s outside world knowledge (De Beaugrande 
& Dressler, 1981). Whichever of these two search 
routes is utilized, in logico-rhetorical terms, what 
this means is that the text has requested through 
the use of a co-ordinate arrangement of lexical 
items that a particular feature shared by the two 
movies (“happenings”) be processed in a like 
manner totwo in which they differ (“occupation,” 
“background”). 

Here isasecond version of the text, rewritten by 
another text-maker of broadly similar ability: 


The movie “Notting Hill” which was released in 
this summer can be compared to the movie “Pretty 
woman” which was made in 1990. Though entire 
structure is very similar, the character’s social 
class and living circumstances are very different. 
For example, in “Notting Hill,” a main woman 
character is the famous actress in Hollywood but 
a main man character is 35-year-old divorcee 
who runs a small travel bookstore in Notting 
Hill, London. In “Pretty woman,” a man is a 
rich businessman who visit Hollywood on busi- 
ness but a woman is a Street girl. However, these 
differences are an important factor contributing 
the similarity of the basic structure of two movies 
which tells us a love story that is hard to exist in 
real world. In both movies main characters who 
are different in social class and living circum- 
stance meet accidentally and fallin love with each 
other. Though, in the middle of the stories of both 
movies, they broke up unfortunately because of 
misunderstandings, conflicts, and obstacles which 
are caused by very different living circumstances 
and social class, their relationship turns out to 
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be true love at the end. They certified their own 
love. Besides this structural similarity that tells 
us unrealistic but romantic love story, the same 
leading actress, Julia Roberts, was very proper and 
well matched to the both movies. Her understated, 
unanced performance gave great contribution 
for both movies, especially in “Notting Hill,” 
playing a role not too far removed from her own 
existence. “Notting Hill” and “Pretty woman” 
are different in character’s social class and the 
living circumstance but similar in telling us ro- 
mantic love story. 


In this version of the text, the majority of the 
textual revisions appear to be motivated chiefly by 
the replacement of the unmarked/marked ordering 
structure of the original text by a marked/un- 
marked one in the second. As a result, the second 
text is somewhat longer and probably less efficient. 
The text-maker’s substitution of the marked/un- 
marked order has involved reworking somewhat 
haphazardly certain of the clause elements: “Be- 
sides this structural similarity that tells us unre- 
alistic but romantic love story, the same leading 
actress, Julia Roberts, was very proper and well 
matched to the both movies. Her understated, un- 
anced performance gave great contribution for 
both movies, especially in “Notting Hill,” playing a 
role not too far removed from her own existence.” 
This reordering does not represent an improve- 
ment. A second rewording occurs as part of the 
description of the plot. Here, the major changes 
are the slight thematic coloring and the attempt 
to adda more definite resolution: “Though, in the 
middle of the stories of both movies, they broke 
up unfortunately because of misunderstandings, 
conflicts, and obstacles which are caused by very 
different living circumstances and social class, 
their relationship turns out to be true love at the 
end. They certified their own love.” Once again, 
this rearrangement is not noticeably better than 
the wording employed by the original. 

What these ineffectual revisions indicate 
is something profoundly important for second 
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language studies: a learner text-maker is simply 
unable to perceive the ineffective choices in texts at 
levels of sophistication higher than those he or she 
is capable of creating. It is for this reason that this 
learner text-makerresponds to the task of optimiz- 
ing inefficient language choices in another text by 
merely redistributing the original inefficiencies. 
This insight is of crucial importance to the theory 
of second language textual ability. Among other 
things, the idea that learner text-makers can only 
redistribute the inefficiencies in texts composed at 
ahigher level of language development provides a 
secure means for gauging many aspects of second 
language development. 

Here now is the same text rewritten by asecond 
language text-maker of mid-level ability: 


The movie “Notting Hill” which was released in 
this summer can be compared to the movie “Pretty 
Woman” which was made in 1990. First, the main 
actress is the same person, Julia Roberts. She 
performs her part with brilliance in both movies, 
even though the roles of her characters are totally 
different; one is a Hollywood star as she is in real 
world, and the other is a prostitute. She acts so well 
that she looks proper and natural in both movies. 
Secondly, the basic structure of the plot is similar. 
The two movies are modernversions of Cinderella 
love story, which is hard to exist in the real world. 
Main characters who are different in social class 
and living circumstance meet accidently and fall 
in love with eachother. They have misunderstand- 
ings and conflicts at first because they have lived 
in very different ways. In spite of that, they realize 
that they have found their true love after all in 
each other. Although the basic plots are similar, 
the details of the movies are different in terms of 
occupations of characters and backgrounds. In 
“Notting Hill,” the main female character, who 
is a world famous movie star, visits Notting Hill 
in London where the main male character runs a 
small travel bookstore. In “Pretty Woman,” the 
man is a rich businessman who visits Hollywood 
on business whereas the woman is a street girl. 
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Another different thing between the movies is who 
plays the Cinderella role. In “Pretty Woman,” 
Julia Roberts meets her perfect prince who she 
has dreamt of whereas in “Notting Hill” the male 
character, who is a 35-year-old ordinary divorcee, 
falls in love with the great actress, who is Roberts. 
For these reasons, the two movies can be seen as 
similar and different. 


At the level of grammar, the choices demon- 
strate a marked improvement. For example, “the 
main female character,” “a world famous movie 
star,” “the main male character,” “a small travel 
bookstore,” “the man,” “a rich businessman,” 
“the woman,” and “a street girl” are all correctly 
chosen. Nonetheless, there are still a couple of 
inappropriate choices: for example, “in [the] real 
world,” “[the] Cinderella love story” and “[The] 
main characters.” At the level of lexis and colloca- 
tion too, a number of the choices have now been 
optimized. Instead of “She was very proper and 
well-matched to the movies,” the text now reads: 
“she looks proper and natural in both movies”; 
while instead of “certify their own love,” this text 
nowreads “found theirtrue love ... in eachother.” 
However, the non-standard collocation “which 
is hard to exist in the real world” is incorrectly 
retained. Atthe level of logico-rhetorical structure, 
this text correctly fronts the description of the 
plot structure with its Orientation: in other words, 
the idea that these two movies are Cinderella 
stories now precedes the description of the two 
movies’ common plot structure. This second text 
also eliminates the inappropriately end-focused 
subordinate clause “So they break up” in order to 
prevent its possible misreading as the climax of 
the plot. However, the logico-rhetorical structur- 
ing “at first” which has been added is positioned 
after the complement “misunderstandings and 
conflicts.” In other words, the text-maker has not 
recognized that the optimal position would be as 
amarked Theme to guide the reader’s processing 
of the entire clause: “At first, they have misunder- 
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standings and conflicts because they have lived 
in very different ways.” 

Finally, we can compare both re-textualiza- 
tions with a fourth version written by a student 
with a very high level of second language so- 
phistication: 


“Notting Hill” and “Pretty Woman” are mod- 
ern day versions of ‘Cinderalla.’ Both movies 
feature Julia Roberts as a starring role in a love 
story which is hard to exist in the real world. 
The basic structure of the two movies are very 
similar. Characters coming from entirely differ- 
ent social class and culture meet each other by 
chance and fall in love. Since their lives have 
been completely different, lovers find themselves 
in a quagmire of misunderstandings, conflicts, 
and unforeseen obstacles. Although they break 
up, they unite only to certify their love and to live 
happily ever after. However, there are noticeable 
differences between the two movies as well; the 
roles are reversed. Whereas in ‘Pretty Woman,’ 
it is the man who is rich and wealthy, the woman 
in ‘Notting Hill’ is the one with wealth and fame. 
While “Pretty woman” is a love story between a 
hooker and a businessman, an actress and a 35- 
year-old bookstore owner falls in love in “Notting 
Hill.” Nevertheless, the two movies tell a tale 
which is hard to find in real life. Very much like 
‘Cinderalla,’ ‘Notting Hill’ and ‘Pretty Woman’ 
are modern day fairy tales about unlikely couples 
finding themselves in love. 


In this fourth version, the majority of the 
problems relating to the grammar have been 
successfully resolved. The major improvement, 
however, stems from the text-maker’s inspired 
decision to place the Orientation at the very begin- 
ning. This allows the reader to process the entire 
text coherently in terms of the Cinderella story. In 
other words, the text-maker has made a substantial 
improvement to the logico-rhetorical structure of 
the text. In this version too, the text-maker clearly 
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understands the need to make main information 
truly main and subordinate information truly 
subordinate. This explains why the information 
about the year of release has been eliminated and 
why the entire text segment about Julia Roberts has 
been subordinated to the idea of the two movies 
as improbable love stories. As a result, the text- 
maker has eliminated entirely the disconnected 
sequence “Jn first, ... Besides, ... Someone say 
that... Though entire structure is very similar,...” 
and substituted instead the well-formed sequence 
“Notting Hill” and “Pretty Woman” are modern 
day versions of ‘Cinderalla’... Both movies... The 
basic structure of the two movies... However,.. 
Nevertheless,... Very much like ‘Cinderalla,’....” 
As a result, the choices now correctly guide the 
reader through the main transitions in the over- 
all “point” of the text. Of course, there are still 
occasional problems with the grammar (“as a 
starring role”), the lexical collocations (“hard to 
exist in the real world” and “certify their love”); 
and the logico-rhetorical structure (“there are 
noticeable differences”), but in other respects, 
this text clearly approaches the sophistication of 
a first language text-maker. 


CONCLUSION: COMPUTERS AND 
INEFFICIENTLY SELF-REGULATING 
LEARNER TEXTS 


Situationally fine-tuned as they are, written texts, 
including the written texts of second language 
learners, are among the most difficult of human 
tasks. They involve complex considerations of 
vocabulary, register, logic and planning. As a 
result, they present immense problems for both 
the writer and for the analyst who wishes to say 
intelligent things about them. The situational fine- 
tuning of all genuinely creative texts is the reason 
that the investigation of ESL written texts must 
be extremely sensitive. The analysis presented 
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here of the multiple textualizations of the same 
basic information should alert the researcher to 
the obvious limitations of simple word frequency 
counts in attempting to gauge second language 
development accurately. The future investigation 
of this recent field requires the active intelligence 
of the researcher performing qualitative analysis 
on the inefficiently self-regulating nature of a 
variety of learner texts. In other words, computer 
techniques may be used to facilitate certain te- 
dious mental operations, but number crunching 
and simple lexical frequency profiles are unlikely 
to reveal much that is of genuine interest about 
learner textualization. The analysis of any written 
text involves the active consideration of the text- 
maker’s motivation for the selection of language 
items at a variety of finely gradated levels. In the 
case of the learner text, motivation is primarily 
determined by the text-maker’s uneven awareness 
of the distinct but interlocking levels of gram- 
mar, lexical collocation, and logico-rhetorical 
structure. 
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KEY TERMS 


Comment: A sentence that picks up the given 
information of the previous sentence and elabo- 
rates it in some way. 


Emergent Texture: In Murphy (2001), the 
concept of emergent texture is defined as “the 
manner in which interlanguage texts gradually 
extend their use and control of the grammatical 
means used to establish lexical and textual cohe- 
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sion” (p. 154). The morerefined definition utilized 
in this chapter is that emergent texture refers to a 
given text’s inefficient utilization of the full set of 
grammatical, lexical, and logico-rhetorical ties. In 
this sense, an analysis of the state of the emergent 
texture of a second language text is one measure 
of its distance from a reconfigured first language 
textualization of the same information. 


Inefficiently Self-Regulating System: A text 
is an inefficiently self-regulating system when its 
grammatical, lexical and logico-rhetorical ties are 
improperly configured. As a result of this, the tex- 
tual directives lead the reader into the discovery of 
ambiguities, discrepancies, paradoxes, contradic- 
tions and redundancies. While the reader’s first 
language knowledge may sometimes be enough 
to recover the intended meaning, some of these 
misused or missing directives will result in the 
reader’s failure to understand (portions of) the 
text. All poorly written texts, including the specific 
subset of second language texts, may be regarded 
as inefficiently self-regulating systems. 


Logico-Rhetorical Structure: In functional 
grammar, the logico-rhetorical structuring of a 
text refers to the intermediate range of choice 
situated between the grammar and the lexis. In 
conjunction with the punctuation, itis this interme- 
diate range of choice that is used when configuring 
the text’s logico-rhetorical structure. The choice 
of different logico-rhetorical structuring allows 
the same textual information to be presented in 
a definite (but not unlimited) range of alternative 
textualizations. In the terms of Robert De Beau- 
grande (1980), the logico-rhetorical structure of 
the text is a form of procedural knowledge. In 
well-organized texts, this procedural knowledge 
is “formatted as programs designed to run in spe- 
cifically anticipated ways” (p. 65). One example 
of a program designed to run in an anticipated 
way is the situation-problem-solution-evaluation 
structure. It follows that an inefficient text runs 
in unanticipated or unpredictable ways. 
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Markedness: According to Roman Jakob- 
son, “the general meaning of a marked category 
states the presence of a certain property A; the 
general meaning of the corresponding unmarked 
category states nothing about the presence of A 
and is used chiefly but not exclusively to indicate 
the absence of A (quoted in Greenberg, 1966, p. 
25). For example, in some environments, actor is 
to actress as “male thespian” is to “female thes- 
pian.” However, in other environments, actress 
is neutralized by the term actor because actress 
can only refer to female thespians. In addition, 
actress is morphologically the more complex of 
the two terms, requiring the addition of an extra 
morpheme. For this reason, within the terms of the 
unmarked/marked distinction, actor is unmarked, 
whereas actress is marked (Clark & Clark, 1978, p. 
231; Greenberg, 1966, p.26). In narrative fictions, 
an extremely important distinction may be made 
between chronologically ordinary narratives such 
as romances and marked order narratives such 
as detective fictions and Gothic horror stories. 
There is also the important secondary distinc- 
tion between the marked character and the other 
characters, who are all unmarked (Murphy, 2004, 
2005b). 


Move: A sentence that picks up the new in- 
formation of the previous sentence and extends 
it in some way. 


Self-Regulating System: First proposed by 
Wolfgang Iser in The Act of Reading (1978), the 
concept of the text as a self-regulating cyber- 
netic system was more precisely formulated by 
Robert De Beaugrande in Text, Discourse and 
Process (1980). According to De Beaugrande, 
“The stability of the text as a cybernetic system 

. is characterized by its connectivities, i.e. 
unbroken access among the occurring elements 
of the participating language systems.” In other 
words, a text will contain “sequential connectiv- 
ity of grammatical dependencies in the surface 
text,” “conceptual connectivity” and “planning 
connectivity” (p. 17). In a study of Charles Dick- 
ens’ Oliver Twist, Murphy (2005a) extended the 
concept of the self-regulating textual system to 
the nineteenth century novel by explaining how a 
reader might process the discrepancies discovered 
in the clash of directly quoted character speech. 
These discrepancies are resolved by means of the 
conversation monitoring of the narrative voice. 


Texture: In Halliday and Hasan’s Cohesion 
in English (1976), “a text has texture, and this is 
what distinguishes it from something that is not 
a text. It derives this texture from that fact that it 
functions as a unity with respect to its environ- 
ment” (p. 2). The texture of any text is constituted 
by the five major cohesive ties: those of reference, 
substitution, ellipsis, conjunction and lexis. 
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Section V 
Self—Access Support for 
Language Acquisition and 
Learning 


This section contains two chapters on self-access support for language learning. Starting with an evalu- 
ation of 46 self-access centers throughout the world, the second chapter describes the conceptualization 
of an autonomize learning space for self access learning in Japan. 
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ABSTRACT 


This chapter discusses the results of a study into the use of technology in the specific pedagogical setting 
of self-access centers. As part of the study, 46 self-access centers in six countries were visited and an 
evaluative framework was applied to each of them in order to be able to compare the types of support 
offered by the centers with the help of technology and the range of tools used by them to deliver that 
support. It was found that the use of technology was limited, especially for the provision of learning 
support, as opposed to the more common provision of language learning content. 


INTRODUCTION 


Recent technological developments offer great 
potential for language learning and teaching. But 
how are such developments drawn on in practice? 
Self-access centers are often said to be technology- 
heavy environments and their role in providing 
flexible opportunities for individualized learning 
may make them particularly suited to the practical 


application and development of new technologies. 
This chapter draws on an evaluative framework 
developed by the authors to chart current use 
of technology in 46 self-access centers in five 
countries. The results were analyzed to identify 
the relative use of a range of both practical and 
learning support tools and to identify the use of 
certain tools versus others. 


Copyright © 2008, IGI Global, distributing in print or electronic forms without written permission of IGI Global is prohibited. 
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BACKGROUND 


When investigating applications of technology 
in language learning and teaching, it is useful to 
investigate practical uses inreal contexts. This can 
inform practitioners working in those contexts, 
and show how their use of the technology differs 
from others. It can also inform researchers and 
others interested in CALL and related areas. A 
wide range of tools and approaches now exists in 
CALL but it is not always clear how those tools 
are selected, adapted, developed, implemented 
and evaluated in teaching contexts. By looking 
at the use of CALL in one type of pedagogical 
environment we can gain insight into which tools 
are favored in practice and which approaches to 
learning and teaching they support. 

This chapter focuses specifically on the use of 
CALL inself-access centers (SACs). Such centers 
have become increasingly common inrecent years, 
both in language schools where they supplement 
teaching and learning opportunities as well as in 
higher education where they perform an important 
support role for students in mainstream courses. 
A self-access center ‘consists of a number of re- 
sources (in the form of materials, activities and 
help), usually in one place, that accommodates 
learners of different levels, styles, and with dif- 
ferent goals and interests. It aims at developing 
learner autonomy among its users’ (Reinders & 
Cotterall, 2001, p. 87). There are many types of 
SACs and they differ widely, but on the whole 
they share a number of characteristics. In many 
cases: 


. Use of the center is voluntary. 

. Learners determine what they learn, how 
and when. 

. There is little or no formal assessment. 

° Staff is available and offer advice, select 
materials and activities, and encourage 
reflection and autonomous learning skills. 
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Perhaps one of the key words to summarize 
the above list is ‘flexibility;’ SACs offer a very 
flexible and learner-centered approach to learning 
(and teaching). This flexibility poses challenges to 
those working in SACs. What are the best ways 
to make resources available as widely as possible 
without constraints of time and place? How can 
student learning be monitored if students them- 
selves decide what to learn? How can feedback be 
provided if students decide when (and if) to come 
back to the center? Possibly as a result of these 
challenges, SAC practitioners have often looked 
at technology to support their work and SACs are 
perceived to be ‘technology-rich’ environments 
(Gardner & Miller, 1999). What solutions have 
been found in practice to the specific challenges 
the SAC environment poses? And how is learning 
supported at the practical as well the pedagogical 
level, through the use of technology? 


LITERATURE REVIEW 


No previous research exists to our knowledge that 
has specifically investigated the use of technology 
across several SACs. There are reports of initia- 
tives in the area of CALL in individual centers 
and we will briefly discuss these below. 

A great deal of the research focuses on the 
application of technology for the delivery of lan- 
guage content. For example Gardner and Blasco 
Garcia (1996) and Gardner (1994) discuss the use 
of interactive video with bilingual support screens 
to provide authentic language input. Others used 
the capabilities of word processors to support 
student writing. For example, Milton, Smallwood 
and Purchase (1996) developed a word processing 
tool that supported students in generating and 
working out ideas for writing academic texts. 
Early reports also discuss the development of 
multimedia software especially for self-study of 
listening and vocabulary skills (e.g., Mak, 1994). 
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In addition to such ‘home-grown’ applications, 
commercially available CALL materials (mainly 
cdroms) are frequently used but little has been 
formally reported on the effectiveness of the pro- 
vision of such materials. One study (Reinders & 
Lewis, 2005) found that many of such materials 
did not include the necessary support mechanisms 
to make them suitable for self-study. 

Learning management systems (LMS) arealso 
used in SACs. For example WebCT, Moodle and 
specifically designed LMS. However, the use of 
LMS is not as common as in classroom contexts. 
This is likely as a result of the highly flexible na- 
ture of self-access as mentioned above. LMS are 
particularly suited to the task of delivering content 
and managing groups of learners (‘classes’), but 
in self-access each learner works independently 
and there is no set selection of materials. 

Technology has been put to use for the purposes 
of advising students. Makin (1994) reports an early 
use of e-mail to provide ‘telesupport’ or learning 
support through an ongoing e-mail conversation 
focusing on the learning process rather than 
content (that is, not teaching language but rather 
giving advice on how to learn independently). 
Altshul (2001) discusses the benefits of e-mail 
for advisory sessions and found that students 
appreciated the flexibility it offered. Advisors 
found many potential benefits to regular advising 
but warned that such type of support would need 
to be accredited as part of teachers’ workload to 
be successful. MOOs (or multi-user dimension, 
object-oriented) have been put to use to encour- 
age student-student interaction, raise awareness 
and foster autonomy (cf. Schwienhorst, 2003 for 
a discussion, not specific to self-access). 

Some recent reports describe technology- 
based systems for learning rather than for the pro- 
vision of language content only. Reinders (2006), 
for example, describes an electronic learning 
environment that functions as a shell. The shell 
provides access to language content and includes 


mechanisms to support self-directed learning such 
as monitoring of student progress and intervention 
inthe form of advice when students’ learning goals 
and their learning behavior (e.g., their materials 
selection) do not match. Toogood & Pemberton 
(2002) describe the virtual english language ad- 
viser software that was designed to help students 
develop a personalized learning plan and suggest 
appropriate materials and strategies. Gick (2002) 
describes a program of blended learning where 
traditional and online learning are combined for 
a grammar course with the help of CALL within 
a self-access center. In this program students 
make a personal working plan for grammar and 
use CALL materials produced in-house which 
they then discuss with a counselor. This course 
combines online materials and activities with 
classes where astudy plan is developed, monitored 
and assessed. Learner training is offered both in 
class and online. 

Of course, SACs do not operate in isolation 
but are connected with other support mechanisms 
available in the institution. Centralized reposito- 
ries (e.g., library resources and databases), account 
authentication and student administration systems 
as wellas learning-related support structures such 
as academic portfolios and LMS are potentially 
available to SACs to draw on. In addition, SACs 
often work together with different departments 
to provide language support alongside academic 
courses and the available infrastructure is shared 
between them. Although such resources poten- 
tially play animportantrole in enhancing the sup- 
port offered in SACs, little has been reported on 
their practical implementation. From the limited 
information available in the literature, it appears 
that the use of technology in self-access has been 
mostly limited to alternative forms of providing 
language learning content. Only recently have 
new developments taken place that attempt to 
provide learning support (in addition to language 
content). 
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THE STUDY 


This chapter reports on some of the results from 
a larger study into current practice in self-access 
worldwide. The aim of the study was to identify 
the different types of support offered by SACs 
and their practical implementation. In addition, 
the study aimed to chart the strengths and weak- 
nesses of self-access as alanguage support option. 
The results reported here relate specifically to the 
use of technology in the centers with the aim of 
answering the following research questions: 


1. Whatis the range of support offered through 
technology in self-access centers world- 
wide? 

2. | Whatare the types of tools used to offer that 
support? 


As part of the study, a total of 46 SACs were 
visited in Germany (10) and Switzerland (2), Hong 
Kong (6), Spain (15) and New Zealand (13). The 
centers were selected on the basis of their affilia- 
tion with a tertiary institution and on the strength 
of their excellent reputation as determined from 
the literature and through recommendations from 
anumber of experts in the field. Some centers were 
included that were located in language schools of- 
fering academic preparation programmes. All of 
the centers had been well-established at the time 
the visits took place with most having operated 
for more than five years. 

Each center was visited by one of the research- 
ers who conducted an in-depth interview with 
the manager or a representative staff member (or 
both in some cases). The interviews consisted of 
35 questions in which 25 were open questions 
and the remaining ten semi-structured (see Ap- 
pendix A). The interview was divided into nine 
thematic blocs: 


1. learners’ and teachers’ attitudes towards 


autonomous learning in the self-access 
center, 
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2. a SWOT analysis (strength, weaknesses, 
opportunities and threats) of the center, 
counseling services, 

learner training, 

learner profiles, 

materials, 

activities, 

assessment and 

Evaluation. 


SO ANAM W 


These are some of the areas generally regarded 
as central to the field of autonomy and self-ac- 
cess (cf. Benson, 2001, Gardner & Miller, 1999). 
SWOT analyses have been operation in the area 
of business for many years. This type of analysis 
was chosen because it allows both an investiga- 
tion of the state-of-the-art of the centers (through 
an investigation of strengths and weaknesses) as 
wellas possible future directions (through threats 
and opportunities). 

Discussion of the use of technology permeated 
the interviews throughout these nine thematic 
blocs and this information was probed further by 
additional means (see below). Interviews lasted 
on average ninety minutes. 

In addition to the interviews, a systematic 
observation of each center was undertaken and all 
processes and support tools in place to facilitate 
self-access learning were identified and catego- 
rized. Specific attention was given to the role 
of technology in the day-to-day running of the 
center and to its pedagogic contribution. For the 
purposes of the study follow-up questions were 
submitted to some of the participants to obtain 
further clarification on issues related to the use 
of technology in their centers. The use of sys- 
tematic observations was needed to complement 
the information from the interviews. The guided 
visit to the center prior to the interview and the 
perusal of the previous documentation allowed 
the researchers to ask more focused questions 
during the interviews and observations afterwards 
were used to confirm comments made during 
the interviews. For example, if an assessment 
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procedure was mentioned during the interview, 
the researcher looked through the relevant mate- 
rials or where online resources (¢.g., a learning 
portfolio) were discussed, the researcher would 
view these materials afterwards. 


EVALUATING USE OF 
TECHNOLOGY IN SACS: THE 
EVALUATIVE FRAMEWORK 


In order to answer the research questions above, 
an evaluative framework for determining the use 
of technology in self-access, developed earlier by 
the authors (Lazaro & Reinders, 2006), was ap- 
plied to the data obtained through the interviews 
and observations. 

The framework (see Table 1) identifies types 
of support (practical and learning) and types of 
tools used. 

The support was further classified by the tools 
used for their implementation (Table 2). 


Table 2. Evaluated tools 


TOOLS 


E-mail 


Chat 


Discussion boards/forums 


E-mail lists 


Online courses 


Internet resources 


Electronic materials 


Software (produced commercially or in-house) 


Electronic tests 


Electronic portfolio 


Activity report 


Students notes 


Learning Management Systems (LMS) 


Electronic questionnaires 


Online booking system 


Table 1. Types of support provided through technology 


PRACTICAL SUPPORT 


LEARNING SUPPORT 


Electronic catalogue 


Language learning materials 


Direct (electronic) access to resources 


Learning activities 


Communication tools 


Computer-mediated language advice 


Administrative support 


Needs analysis tools 


Evaluation processes 


Leaming process planning tools 


Leamer training 


Leaming process monitoring tools 


Assessment 
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DATA ANALYSIS 


The evaluative framework was applied to the 
data generated from the interviews, observa- 
tions and follow-up e-mail questionnaires and 
used to code each SAC according to the types of 
support it provides and the types of tools it uses. 
This yielded: 


. a profile for each individual SAC 

° the percentage of SACs that employed each 
type of support in the framework 

. and as a result, comparative data for the 
centers as well as the relative distribution 
of the support options in SACs. 


Next, the results were further analyzed to 
identify the relative use of practical and learning 
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support tools and to identify possible correlations 
between the use of certain tools versus others. 


RESULTS 


Table 3 shows the results for the use of technology 
for practical and learning support. The results 
have been totaled for each category. 

The table shows that almost no centers use 
technology for administrative purposes. This is 
surprising as more and more tertiary institutions 
are making use of learning management systems 
for managing classes, sending out course materi- 
als and a range of other administrative purposes. 
Perhaps the less organized nature of self-access 
(there are no fixed groups, no set timetable, no 
curriculum, etcetera) makes it more challenging 


Table 3. Practical and learning support offered by the SACs (n=46) 


PRACTICAL SUPPORT n= 46 
Electronic catalogue 32 (70%) 
Direct (electronic) access to resources 13 (28%) 
Communication tools 34 (74%) 
Administrative support 3 (7%) 
Evaluation processes 14 (30%) 
LEARNING SUPPORT n= 46 
Language learning materials 45 (98%) 
Learning activities 15 (33%) 
Computer-mediated language advice 16 (35%) 
Needs analysis tools 13 (28%) 
Learning process planning tools 7 (15%) 
Learner training 7 (15%) 
Learning process monitoring tools 9 (20%) 
Assessment 9 (20%) 
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to successfully use existing tools. This impression 
was somewhat reinforced by the fact that the three 
centers that use technology for administrative 
support have custom-made programmes. Two 
of these offer online booking systems for their 
resources and only one of the three centers of- 
fers a wider range of administrative support that 
includes online resources booking, matriculation, 
timetabling, and so on. 

Only one in three centers made use of technol- 
ogy for evaluation purposes. The main reason is 
that most of centers simply do not do much in the 
way of evaluating efficiency and effectiveness of 
learning in self-access. A study by Reinders and 
Lazaro (2006) data reveal that 24 out of 46 of 
the centers studied do not carry out any type of 
assessment. Although all interviewees acknowl- 
edged the importance of such evaluations, there 
are considerable practical difficulties as reported 
in the literature (cf. Morrison, 1999). One reason 
is the difficulty of attributing learning gains in 
an environment where variables cannot be ad- 
equately controlled for. Itis, for example, difficult 
to determine how much of the progress would 
be due to the work in the SAC and how much to 
work completed outside the center. In addition, 
one cannot be sure if the students who come to 
SACs are more motivated or in some other way 
more predisposed towards self-access learning 
(i.e., is the effect of self-access learning causal 
or correlational?). In addition, it is unclear what 
is to be measured. Self-access language learning 
aims to facilitate language acquisition but in ad- 
dition places great value on the development of 
learning skills, awareness and learner autonomy, 
areas that are notoriously difficult to measure. 
Although technology may have the potential to 
play a role here, clearly no practical application 
has been found up to this point. 

The use of technology for learning support 
seems high but is restricted mainly to the provision 
of language learning materials, activities and com- 
puter-mediated advice. Interestingly, also about 
one-third of all centers make use of technology for 


needs analysis purposes. In one center a custom 
needs analysis questionnaire was designed that 
required students to self-assess their level and that 
recommended priorities for learning based onthe 
student’s input. In other centers the needs analysis 
process consisted of a diagnostic test followed by 
recommendations. The reason for the high use of 
technology for needs analysis purposes is that itis 
essential to successful self-access learning. Unlike 
in language courses, students do not enroll for a 
course at a particular level and do not get regularly 
assessed. Instead, they need to determine their 
own pathway through the available support and a 
needs analysis clearly helps in this regard. In ad- 
dition, as language advisory services are offered 
in most SACs, an electronic needs analysis that 
the students can complete before meeting with 
their advisor saves time and thus money (advisory 
services are usually conducted one-on-one and 
can thus place a considerable financial burden on 
the center). The advisors draw on the results of 
this preliminary analysis to inform the session 
and to be better able to support the student. It 
also allows for standardization of the advisory 
session format. 

The use of technology for more advanced 
purposes such as assessment, planning, and 
monitoring is relatively small at around 15-20 
percent. These are particularly challenging areas 
in self-access as was clear from the interviews 
and from previous literature (cf. Morrison, 1999). 
One of the reasons for this is that students often 
self-select their course of study, making it dif- 
ficult to know what to monitor or assess. At the 
same time, it could have been expected that the 
computer would have been used more to keep 
track of students’ usage of the center and its re- 
sources to a greater extent than is evident here. 
Computers are obviously good at recording large 
amounts of information related to a student’s 
work and can, in principle, tailor follow-up and 
assessment based on that information. It seems 
that this potential has not yet been realized in the 
area of self-access. 
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Table 4 shows the results for the use of specific 
tools to offer the above practical and learning sup- 
port. Where one SAC uses a tool for more than 
one purpose (e.g., chat for the purposes of com- 
munication as wellas language learning materials) 
this was only counted once. We were interested 
mainly in the range of tools employed. 

The results show that common tools such as 
e-mail and Internet are used widely in self-ac- 
cess (although perhaps one would have expected 
more centers to make use of Internet resources 
than the 72 percent. Clearly, Internet access is 
still problematic in a fair number of cases even 
in the generally ‘wired’ countries included in 
the study). Not surprisingly, the use of language 
learning software and electronic materials is also 


Technology in Support of Self-Access Pedagogy 


widespread; self-access centers have traditionally 
been repositories of vast numbers of resources. 
What is striking is that the use of most other 
tools is very limited (mone of the tools are used 
by more than 10 centers). Even easily available 
tools such as chat, discussion and e-mail lists were 
not used. This is unexpected given the nature of 
SACs: with the irregular access by most students, 
asynchronous tools such as discussion groups and 
lists can potentially perform a very useful func- 
tion in creating online communities and to ensure 
that support is available on a continuous basis. 
SACs are largely commensurate with principles 
of flexible learning and chat facilities could be 
used to make learning opportunities and support 
even more widely accessible. However, this tool 


Table 4. Tools used to deliver practical and learning support (n=46) 


TOOLS eae | 


Chat 


35 76%) 


4 (9%) 


Discussion boards/forums 2 (4%) 
2 (0%) 


Online courses 


4 (9%) 


33 (72%) 
21 (46%) 


Software (produced commercially or in-house) 


Electronic tests 


44 (96%) 
7 (15%) 


Electronic portfolio 5 (11%) 


Activity report 


Students notes 


9 (20%) 
1 (2%) 


Learning management systems (LMS) 6 (13%) 


Electronic questionnaires 


6 (13%) 


Online booking system 2 (4%) 
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was used in only four centers. The effectiveness 
of such tools has been found to be dependent on 
their degree of structure and guidance (cf. Salmon, 
2002). As guidance and structure are not two 
characteristics of self-access this may explain 
why these tools are under-used. 

A range of other technologies that could con- 
ceivably perform a useful role in SACs such as 
Wikis, blogs/vlogs and podcasts were not used in 
any of the SACs (although research on their use 
was Carried out by at least one center). 


DISCUSSION AND FUTURE 
TRENDS 


The results show that the use of technology in 
self-access is not quite as pervasive as could have 
been expected based on the general characteriza- 
tion of SACs. The main purpose of technology 
appears to be forthe provision of language content. 
Much less use is made of technology to provide 
learning support. Planning and monitoring of 
student learning, for example, are areas where 
technology is not extensively drawn on. This was 
an unexpected outcome as these are the areas 
where self-access has traditionally been strong. 
Often special worksheets and carefully selected 
materials on such topics are available, strategy 
training is given and in advisory sessions (a ser- 
vice most self-access centers offer in some form 
or another) these aspects of learning are dealt 
with extensively. 

Similarly, very few SACs use a wide range of 
technology. There are some centers that clearly 
lead the way and use technology for a variety of 
practical and learning support but most centers 
are limited in this respect. The same applies to 
the range of tools used by the centers. There is 
an awareness of the opportunities technology can 
offer SACs but there are a number of important 
constraints. Some of these are perhaps unsurpris- 
ing and are related to practical issues such as a 
lack of funding. In the words of one manager: 


It is interesting to use the possibilities that the 
Internet and new technologies in general offer. 
On the other hand, there are a lot of problems in 
using them, as large investments are needed, and 
vast material and human resources are needed. 


But several managers also indicated grappling 
with how to make best use of technology in the 
context of self-access. As one manager said: 


Sometimes students expect technology and the 
teachers aren t comfortable with that, because they 
didn’t grow up with that, so we are trying on the 
teaching side to embrace those new technologies. 
Some teachers view this as quite threatening. 


From interviews with SAC managers it was 
clear that most see using technology effectively 
in the special context of a SAC as one of the main 
challenges facing their centers. In the words of 
one manager: 


SACs have their own peculiarities [in terms of 
using technology], so there is no existing frame- 
work to draw on. The answer is to make your 
SAC fit an existing model but by doing so you 
compromise your methodologies. It is like trying 
to use a tool that is not appropriate for this type 
of learning activity. 


Drawing on existing models of educational 
innovation can help characterize the use technol- 
ogy in SACs. In the model below there is a level 
labeled ‘no response’ where challenges have 
not been responded to at all. In other cases only 
cosmetic changes are taking place, for example 
when computers are installed but students are 
not given pedagogic support (e.g., in the form of 
a needs analysis) in using them. Many institu- 
tions are merely coping with change, reacting to 
challenges as they come along, making available 
some of the resources online or offering an e-mail 
service, but as add-ons, not fully integrated into 
the available support. Others are on the way to 
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anticipating change and finding ways of dealing 
with it (‘consolidation’). Yet others initiate change 
and are fully proactive. These responses can take 
place at different levels. Sometimes, individual 
forerunners are the first to notice change and 
find ways of dealing with it. At other times it is 
one department in a university, or a professional 
organization, and, sometimes it is the govern- 
ment. SACs usually operate at the institutional 
level although of course they are affected by the 
other levels, notably through government policy 
in the cases of Thailand and Malaysia recently, 
for example. 

Many of the centers discussed previously seem 
to be atthe reactive level of coping. As educational 
technology becomes available an attempt is made 
at integration into the existing support structure. 
A number have clearly moved up to the level of 
consolidation where pedagogically sound use is 
made of technology. Only a very few are proac- 
tively seeking to draw onthe opportunities offered 
by technology and to create new opportunities 
themselves. In this, SACs seem to be remarkably 
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similar to language classrooms where a wide mix 
of CALL integration can be found but where most 
schools and teachers appear to be operating at the 
reactive/coping level. Although SACs are differ- 
ent types of learning environments to language 
classrooms, in some ways they are perhaps not 
so different after all. 

Although the results reported here give valu- 
able insights into the extent and types of uses of 
technology in self-access learning, future studies 
will need to look more closely at how individual 
students make use of the available technology. 
It is possible that in some centers with extensive 
technology support, little use was made of that 
support and vice versa. There are likely to be ad- 
ditional factors that determine the practical value 
of technology and further research is needed to 
identify those. Nonetheless, the use by students 
of technology depends crucially on its availability 
and the willingness of a center to draw on it to 
support student learning. Our study has shown 
this to vary greatly. 


Figure 1. A model of educational innovation, from Lamb & Reinders, 2005 
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KEY TERMS 


Autonomous Learning: Learning whereby 
motivated learners consciously make informed 
decisions about that learning. 


Independent Learning: Learning without 
the direct help of a teacher. 


Language Advising: Meetings, usually one- 
on-one, between a language advisor anda student 
for the purposes of developing and discussing the 
student’s learning needs, plans and progress and 
to monitor progress and give feedback. 


Monitoring (in Self-Access): The process of 
recording information about student learning for 
the purposes of providing personalized language 
help and feedback. 


Self-Access Center: Consists of a number of 
resources (in the form of materials, activities and 
help), usually in one place, that accommodates 
learners of different levels, styles, and with dif- 
ferent goals and interests. It aims at developing 
learner autonomy among its users. 


Self-Access Learning: Learning that takes 
place in a self-access center. 


Self-Directed Learning: Type of learning 
whereby learners take responsibility for what to 
learn, when and how. 
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APPENDICES 
Appendix A: Interview Questions 
What are in your opinion the learners’ and teach- 


ers’ attitudes towards autonomous learning inthe 
self-access center (SAC)? 


Learners’ attitudes 
Teachers’ attitudes 


What are in your opinion the strengths, the weak- 
nesses, the opportunities and the threats of your 
self-access center? 


Strengths 


Weaknesses 
Opportunities 
Threats 


About counseling service in the center 


Is a counseling service offered in the center? What 
type of counseling sessions do you offer? 

none 1c individual face-to-face interviews 
learner-groups interviews e-mail-counseling 
other: 

obligatory counseling sessions 

free sessions learner asks for it 

counsellor does 
Leamers’ attitudes 
Teachers’ attitudes 
Strengths 
Weaknesses 


Other comments 
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About learner training 


Is there any learner strategy training in the center? 
What type of training? 


none integrated training 
in workshops in counseling sessions 
other: 


Learners’ attitudes 
Teachers’ attitudes 


Strengths 


Weaknesses 


Other comments 


About learner profiles 


19- Are any learner profiles used? How do they 
look like? 

none obligatory 

free other: 


Learners’ attitudes 
about the profile 


Teachers’ attitudes 
about the profile 


Strengths 


Weaknesses 
Other comments 


About materials 


- What type of materials is used at most by 
learners? 


published language-learning materials 
adapted published materials 

authentic materials 

special produced materials 

generic materials 


other: 
print audio video/TV 
Computer programs 
Internet other: 
Strengths of the center’s 
materials 
Weaknesses of the 


center’s materials 


Other comments 


About the activities in the self-access center 


What skills are in your opinion most trained? 


reading comprehension o listening o writing 
speaking phonetics 


grammar other: 
What work forms are in your opinion most used? 


individual activities pair and group activities 
tandem (native-speaker contacts) De-mail- 
tandem 

other: 

Strengths of the center’s 

activities 

Weaknesses of the 

center’s activities 

Other comments 


About the assessment 


How are the learners assessed? 
none self-assessment 
collaborative (with counsellor/ teacher) 
external other: 

Strengths 

Weaknesses 

Other comments 


About the center’s evaluation 


How is the efficiency (use frequency of 
materials, resources and services, of the quality 
of management, value for money of materials 
and equipment, value for money of staffing, the 
deployment of resources (material and human) 
throughout the academic year, the return on the 
overall cost of self-access, the responsiveness of 
self-access to student needs) evaluated? 


none questionnaires interviews 
observations: record behavior 
use and user statistics other: 
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How is the effectiveness (self-access’ facilitation 
of learning, appropriate learning practices in self- 
access learning, changes in learning strategies, 
changes in attitudes and behavior of learners 

and staff over a period of time, learners’ and 
teachers’ attitudes to self-access learning, learners’ 
motivation, consistency with which students 
return voluntarily to self-access learning, the 
development of autonomy in learners, role of 
self-access in enhancing classroom learning) 
evaluated? 


none questionnaires interviews 
observations: record behavior 
discussions with groups of learners 
language tests other: 
none internal evaluations 
external evaluations 

Strengths 

Weaknesses 


Other comments 


Other comments 
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ABSTRACT 


Unlike most CALL labs that are purchased from a vender and employ either generic or commercial 
CALL software and technologically untrained teachers, the CALL lab at Akita Prefectural University 
was specifically designed by trained CALL professionals, who then wrote browser-based software cus- 
tom-tailored to the textbooks and needs of the technology students who use it. This chapter delineates 
a project conducted to further improve the multimedia CALL lab as it prepared for a state-of-the-art 
update in the fall semester of 2006. Since this particular lab is utilized to facilitate the student-centered 
program, as opposed to the traditional, teacher-centered CALL lab that often functions as no more than 
a digital blackboard, the results of this project provided important feedback to allow for the instigation 
of cutting edge Web 2.0 innovations, specifically the open-source VLE called MOODLE. 


INTRODUCTION Thus the state-of-the-art hardware installed at 

the Akita Prefectural University CALL lab in 
Moore’s Law (Moore, 1965) roughly states that 1999 was sadly outdated by the spring of 2006. 
computing power will double every 18 months. Luckily, CALL methodology has not been advanc- 
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ing with such exponential growth. By utilizing 
cutting edge software and textbooks based on 
the most sophisticated techniques and theories 
in applied linguistics, we have managed to keep 
the English language program functioning at an 
optimum level, though no longer at the bleeding 
edge of technological advancement. All that was 
set to change was the introduction, in the fall of 
2006, of an extensive upgrade to the existing 
system hardware bringing it in line with the most 
ultra-modern of the CALL labs currently avail- 
able. In preparation for such a radical update, we 
undertook an in-depth appraisal of the current 
research in the field to identify the advances that 
were most applicable to our current situation. In 
order to precisely ascertain the specific needs of 
out particular students we also conducted research 
on their learning modalities and academic goals. 
Then we endeavored to evaluate the status of our 
current program in order to pinpoint those facets 
that need to be adjusted to provide the optimum 
situation to facilitate second language acquisition. 
Finally, we attempted to identify those future 
trends in the field that will need to be incorpo- 
rated in the further evolution and iterations of 
our complex adaptive learning environment. This 
chapter will present the results of our multidis- 
ciplinary efforts. 


BACKGROUND 


Akita Prefectural University is located on the 
northwestern coast of Honshu, the main island 
in the Japanese archipelago. The technology 
university has no English language department, 
thus the CALL lab serves as the basis for the 
first year language requirement of all the stu- 
dents attending the university. As is the norm in 
21* century Japan, these students tend to avoid 
face-to-face communication. Instead, they prefer 
communication through the media of computers 
or cellular phones. Since English is a required 
subject at the university all of the students are 
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given a proficiency test upon entry, and we used 
that as a baseline for our study. 

The Japanese public school system starts 
mandatory English lessons in the seventh grade. 
Unfortunately the quality of this education is 
sorely lacking. Many of the teachers have little, 
if any, communicative ability and merely teach 
by rote from standardized textbooks. The mo- 
tivational factor for these students is to pass 
multiple-choice English exam that is a part of 
nearly all college entrance exams, thus there is 
little incentive to use the language communica- 
tively. Rote memorization of discrete vocabulary 
and obscure grammatical points thus becomes 
common. The educational tactic most commonly 
employed is the grammar-translation method. At 
best, a school might employ the audio-lingual 
method that is based on the theory of learning 
called behaviorism. 

Modern theories of language learning started 
late 1950s with Noam Chomsky’s Transforma- 
tional-Generative Grammar, and his concepts of 
competence and performance. He was the first to 
define linguistic competence, .”.. whichis confined 
to internalized rules of syntax and abstracts from 
the social rules of language use.” (Stern, 1983, 
p.229). Later this was refined by Dell Hymes 
(1972) and called ‘Communicative Competence;’ 
hence the general term for this methodology is 
“communicative language learning.” Hymes 
(1972) defines “communicative competence” as 
“. competence as to when to speak, when not, 
and as to what to talk about with whom, when, 
where, in what manner” (p. 277). 

At the same time that the concept of commu- 
nicative competence was catalyzing what came to 
be known as communicative language teaching, 
autonomous learning was entering the field of 
language teaching through the Council of Europe’s 
1971 Modern Languages Project (Benson, 2001). 
Autonomous learning can be defined thusly: 


“Autonomy, or the capacity to take charge of one’s 
own learning, is seen as a natural product of the 
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practice of self-directed learning, or learning in 
which the objectives, progress and evaluation of 
learning are determined by the learners them- 
selves” (Benson, 2001, p. 8). 


Communicative language teaching, learner- 
centeredness, and autonomy all bubbled out 
of the cauldron of the radical ‘student power’ 
counter-culture of the late 1960s, but soon moved 
into the mainstream when combined with the 
constructivist theories of learning. Construction- 
ism was described by Candy (1991) as a network 
of approaches that holds that ‘knowledge cannot 
be taught but must be constructed by the learner.’ 
Developmental psychology as portrayed by the 
Russian psychologist Lev Vygotsky and his ‘zone 
of proximal development’ has acquired renewed 
importance in the fields of first and second lan- 
guage acquisition. Vygotsky (1978) explained the 
‘zone of proximal development’ as: 


“... the distance between the actual develop- 
ment level as determined by independent problem 
solving and the level of potential development 
asdetermined through problem solving under adult 
guidance or in collaboration with more capable 


peers” (Vygotsky, 1978, p. 86). 


Social constructionism is asociological theory 
of knowledge. The focus of social construction- 
ism is to uncover the ways in which individuals 
and groups participate in the creation of their 
perceived reality. It involves looking at the ways 
social phenomena are created, institutionalized, 
and made into tradition by humans. Socially con- 
structed reality is seen as an ongoing, dynamic 
process; reality is re-produced by people acting 
on their interpretations and their knowledge of it. 
Inreference to the zone of proximal development, 
Vygotsky (1987) has stated, “What lies inthe zone 
of proximal development at one stage is realized 
and moves to the level of actual development at a 
second. In other words, what the child is able to 


do in collaboration today [he or she] will be able 
to do independently tomorrow” (p. 211). 

We would be remiss if we failed to point out 
how closely this coincides with the work of Ste- 
phen Krashen and his theory of comprehensible 
input. This theory states that the optimum learn- 
ing environment should provide new information 
at the ‘i+ 1’ level, just beyond what the student 
already knows, but which is still understandable 
based on the learner’s background knowledge 
and the context in which it is presented. Krashen 
(1982) wrote: “.. a necessary (but not sufficient) 
condition to move from stage ‘i’ to stage ‘i+ 1’ is 
that the acquirer understand input that contains ‘i 
+ 1, where ‘understand’ means that the acquirer 
is focused on the meaning and not the form of 
the message” (p. 21). 

Scharle and Szabo (2000) point out three 
stages in the process of developing learner au- 
tonomy: raising awareness, changing attitudes, 
and transferring roles. Raising awareness is the 
starting point for bringing the learner’s inner 
processes to the conscious level of their thinking. 
Changing attitudes refers to the breaking of the 
old patterns of behavior through practicing the 
skills learned in the previous stage. Transferring 
roles is the ultimate goal, when the learner can 
finally take charge of his own learning through 
loosely structured tasks. 

Computer-assisted language learning, or 
CALL, canbe considered to be a technology-based 
approach to autonomous learning. Warschaurer 
and Healy (1998) have divided the history of 
CALL into three distinct phases: behavioristic, 
communicative, and integrative. The behavioristic 
phase was dominated by multiple-choice quizzes 
and other drill and test style activities used most 
often in audio-lingual language labs. The com- 
municative phase used more game and simulation 
packages which encouraged problem solving and 
spoken communication. The integrative stage 
of CALL employs multimedia, hypermedia and 
interactive technologies to promote an integration 
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of skills. Thus an optimum CALL environment 
will provide a wide range of input at various levels 
of difficulty and through a variety of multimedia 
modalities. The teacher then acts as a facilitator 
to encourage their access to comprehensible in- 
put, but allows the student to select the material 
autonomously yet in a self-directed manner. Vir- 
tual environments, such as MOODLE, combine 
the best features of the social-constructionist 
paradigm with the most cutting-edge features of 
integrative CALL. 

The most common procedure for setting up a 
university-level CALL lab is to pay a large vender 
toinstalla complete suite of expensive, off the shelf 
hardware, usually based on the inept Microsoft 
Windows operating system, then run the system 
with generic, commercial CALL software. Quite 
often this software is so general in function that 
it does not address the goals of any of the specific 
classes in which it is to be utilized. The institu- 
tion then usually hires teachers with little, if any, 
background in computers and computer assisted 
educational theory. Thus the over-priced lab nor- 
mally functions as little more than an electronic 
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blackboard, and gradually ceases to be used at all. 
The fallacious assumption that merely providing 
more technology automatically leads to better 
language learning was a trap our university did 
not succumb to. 


AKITA PREFECTURAL UNIVERSITY 
CALL LAB 


Configuration 


In contrast, Akita Prefectural University hired 
two teachers with extensive CALL backgrounds 
and experience and allowed them to design the 
CALL lab with the needs of the technology stu- 
dents in mind. From the beginning we insisted 
on Apple computers, and in 1998, that meant 
the new, translucent blue iMac computers. The 
CALL lab of 70 computers is connected via a 
router to a server, now an Apple X-Server, on a 
LAN. The browser-based software is run on this 
intranet. Average class size is over 60 students per 
class. The total number of first year students is 


Figure 1. The set-up of the Akita Prefectural University CALL lab 
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about 240. An instructor and a teaching assistant 
control the class. Figure 1 shows the schematic 
of the initial set-up. 

In addition to the computers, the CALL lab 
was also equipped with the standard tools of 
other multimedia learning centers. TV monitors 
hung from the ceiling and a projector and screen 
were at the front of the class for the OHP as well 
as other video. The TV monitors are used to 
show students how to use computers since each 
individual student works on different tasks on 
the computer. A Bose sound system provided 
the audio for cassettes, CDs, MDs, a VCR, and 
a DVD player. 


Blended Learning Environment 
Wikipedia defines the theory like this: 


“Blended learning is the combination of multiple 
approaches to learning. For example: self-paced, 
collaborative, or inquiry-based study. Blended 
learning can be accomplished through the use of 
‘blended ’virtual and physical resources. Examples 
include combinations of technology-based mate- 
rials, face-to-face sessions and print materials. 
The concept of blended learning has particular 
relevance to language learning” (2006). 


This combination of using computers and tra- 
ditional text-based resources—a ‘blended learn- 
ing’ environment—is exactly what we sought. 
Textbooks were selected according to the students’ 
levels and needs and the syllabus was designed 
to use the spiral effect to reinforce the linguistic 
categories by reiterations at progressively higher 
levels. Only then did we start to consider the ap- 
propriate software for the lab. One point that we 
took into consideration was that we planned from 
the outset to use the computer component of the 
lesson plans to supplement the course material 
rather than to replace it. It was never in our minds 
to use the computer system to act as a stand-in 
for the teacher or as a helper for the students. 


Instead, we created online quizzes based on the 
textbooks we use. The syllabus for our course 
was arranged so that one third of the 90 minutes 
of class time was allotted to the introduction of 
the new material using the chosen text, then the 
next third of the class time was to be devoted 
to task-based communicative activities, either 
group work or pair work, and the final third of 
the class time was allotted for the computer-based 
autonomous learning to supplement the material 
previously presented. 

In dealing with the CALL portion of our les- 
son plan, we needed specific software to produce 
the appropriate activities. Thus we chose Hot 
Potatoes created by Stewart Arneil and Martin 
Holmes of the University of Victoria, Canada 
for their company, Half-Baked Software. Hot 
Potatoes is a software suite that includes six ap- 
plications that enables teachers to create their 
own interactive multiple-choice, short-answer, 
jumbled-sentence, crossword, matching/order- 
ing and gap-filling exercises for the World Wide 
Web. Figure 2 shows an example of gap-filling 
quiz. By using JavaScript to incorporate Cubic 
QuickTime panoramas, MP3 files, and pictures 
we added a multimedia component to provide the 
wide range interactive tasks that meshed perfectly 
with the chosen textbooks. These activities were 
constructed to be browser-based and were run on 
a LAN from an Apple X-Server. Since the CALL 
lab itself was on an intranet rather than connected 
to the Internet, the activities were also posted 
on an Internet-connected server at http://molly. 
honjyo.reccs.akita-pu.ac.jp/lab/default.html so 
that the students could self-access the activities 
from home for additional study. To compliment 
the in-class communicative tasks and the CALL 
components, we also introduced extensive read- 
ing as homework. The students were all assigned 
a minimum number of book reports on graded 
readers to be handed in each month. Again, in 
the spirit of Autonomous Learning, the choice 
of which book to read was left to the student’s 
own discretion. 
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DATA ANALYSIS AND RESULTS 


Often cross-sectional studies tend to be linear 
and one-dimensional. In order to alleviate this, 
we designed out CALL research project to record 
data in three separate modalities, thus giving it 
a multidimensional aspect. The baseline for our 
study was the proficiency test given to all incom- 
ing freshmen at the beginning of the semester. 
Next we gave all of the students a questionnaire. 
Finally we selected eight students for an interview. 
Both the questionnaires and the interviews were 
created according to Michael Wallace’s (1998) 
“action research” paradigm, which is one of the 
mostuseful for collaborative research. On “action 
research” Wallace states: 


“_.itsupposes that one way of solving professional 

problems is through collecting relevant data in 
some systematic way and subjecting those data to 
reasoned analysis. The results of this analysis can 
then become the basis for decisions about further 
professional action.” (Wallace, 1998, p. 253) 


On collaborative research, such as we con- 
ducted, he goes on to state: 


“Action research encourages collaboration. The 
isolation of teachers has often been noted.... The 
‘objective’ aspect of action research (i.e., discov- 
ering facts rather than making judgments) can 
facilitate collaboration. The pooling and sharing 
ofideas can demonstrate the rewards of collabora- 
tive action research.” (Wallace, 1998, p. 254) 


The Action research questionnaires and inter- 
views were given in July 2006. 


Questionnaire 
We conducted a survey using a questionnaire 
asking for the student’s reaction to the contents 


of the Web quizzes, and we had the following 
results. First, the culture quiz (reading quiz) was 
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not considered to be very effective by more than 
AO percent of the students. Second, more than 80 
percent thought that the grammar quiz was effec- 
tive. The interviews later showed that the word 
order grammar quiz was considered to be of high 
value as a preparation for major tests. Third, the 
vocabulary quiz was also highly thought of by 
more than half of the students. This fact shows 
that the vocabulary quiz also was quite popular 
among those students who wanted to learn new 
words. The same thing can be said about the 
crossword. Last, students did not show special 
preferences or resistance toward the Audio script 
and the Answer key to the textbook that were 
provided for them as an ‘easter egg’ hidden on 
the Web page. 

Interms of the computer use in general, almost 
all the students thought that the computer helped 
to improve their English. At the same time, most 
of them did not consider the computer to be too 
difficult to use. Inconclusion, most of the students 
showed a very positive attitude toward the use 
of the computer in a language classroom. We 
selected 90 students out of 240 first year students 
for the data analysis. These results are shown in 
Table 1. 


Interviews 


We conducted interviews to eight students at 
the end of semester. Table 2 shows the results of 
the interviews. During a semester in the twice- 
a-week CALL classes, major written tests were 
given four times and the interviewed students all 
scored in the top percentile. We used their scores 
as the interview criteria, as we wished to elicit 
information on successful language learning strat- 
egies. Thus, it was incumbent upon us to choose 
students who showed the greatest improvement. 
They were highly motivated students who made 
efforts by themselves. In other words, they were 
our best examples of autonomous English learn- 
ers. Our plan was to uncover the study habits 
of those who showed the best improvement. A 
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Table 1. Results from the questionnaire given to the students 


‘To what extent did the following activities in the ieee 
exercises aid the growth of your language skills? ( 3=most 
effective, 1=least effective) 


INO 
answer {students 

la. Culture quiz (reading quiz) To what extent did the 

ollowing activities in the computer exercises aid the 

growth of your language skills? (3=most effective, 1=least 

effective) 

a. Culture quiz (reading quiz) ie ae 

ro arf pop pf 

eS i a 

A 
. Answer Key to “Language Check” 


Rank the statement that best summarizes your reaction to 
leach statement. ( 3=most effective, 1=least effective) 


a. The computer helped me to improve my English skills. te oe 


Ib. It was difficult to learn to use the computer. 


aa == 
a Culture quiz (reading quiz) To what extent did the following 
activities in the computer exercises aid the growth of your 16.7% 40.0% /42.2% |1.1% 100.0% 
language skills? (3=most effective, 1=least effective) 


Rank the statement that best summarizes your reaction to F b 1 I otal no. of 
leach statement. ( 3=most effective, 1=least effective) answer _ |students 
Rank the statement that best summarizes your reaction to eac 
statement. (3=strongly agree 2=agree, 1= disagree) 
a. The computer helped me to improve my English skills. 51.1% 46.7% [2.2% ie 0% 


To what extent did the following activities in the Predehoal 
exercises aid the growth of your language skills? ( 3=most 
effective, 1=least effective) 


Tammar quiz (word order quiz 
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study of the table on student motivation shows 
that male students tend to learn English for their 
future career and more female students study 
English for enjoyment. Specifically, all the male 
students answered either “to get a job” or “to pre- 
pare for the graduate school” to question number 
two, while most female students answered that 
English is their hobby. Another typical differ- 
ence is that most male students put a low value 
on the computer culture quiz, which consists 
of a QuickTime Cubic panorama picture and a 
reading passage with comprehension questions. 
If the male students were looking for a shortcut 
to the better scores in vocabulary and grammar 
tests, then obviously the computer culture quiz 
would have been deemed a less important part of 
the lesson. It seems that they did not have enough 


Table 2. Results of the interviews 


The CALL Lab as a Facilitator for Autonomous Learning 


time and energy to enjoy those multimedia quiz- 
zes. Inconclusion, the female students spent more 
time reading extra books and thus the computer 
culture quiz inspired them to read more than ten 
extra English books during the semester. And the 
reading in turn improved their skills at English. 

These interviews added more human details to 
the cold facts generated by the questionnaires, as 
well as opening a window into the deeper motiva- 
tional factors effecting our learning environment. 
These interviews confirmed our conclusions that 
adding the social-constructionist, interactive 
dimension of Moodle to the Blended Learning 
activities already being employed could enhance 
the student’s motivation, and refocus their personal 
goals towards true communication rather than 
merely excelling in exams. 


Student AJ Student BI 


Question #2] job after 
graduation 
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Student Motivation Interview— 
Question Key: 


1. How long have you been studying Eng- 
lish? 

2. Why do you study English? 

3. | How would you describe your motivation 
at this time? High/Average/Low? 

4. Would you say that your motivation has 
changed at all during your period of 
study? 

5. | What would you say are the things that have 
affected your motivation over your period 
of study? 

6. Canyousuggest anything that could happen 
or could be done at this time to improve your 
motivation? 


Table 3 


Students’ Answers to the 
Questionnaire 


To what extent did the activities (Table 3) in 
the computer exercises aid the growth of your 
language skills? (3=most effective, 1=least ef- 
fective) 

Rank the statement that best summarizes your 
reaction to each statement. (3=strongly agree, 
2=agree, 1=disagree) (Table 4). 


FUTURE TRENDS 


The ultimate goal for our instructional methodol- 
ogy is to support our students’ use of autonomous 
learning both inside and outside of the classroom. 


Student A StudentB StudentC StudentD StudentE StudentF StudentG Student H 


(male) (male) (female) 


a. Culture’ 
quiz 
(reading 
quiz) 


quiz (word! 
order quiz) 


(female) (male) (male) 


(female) (female) 


di 
e. Audio 
script 


491 


Presented by: https://jafrilibrary.com 


Presented by: https://jafrilibrary.com 


The CALL Lab as a Facilitator for Autonomous Learning 


Table 4 


a. The 
compute 
helped me 
to improve 
my English 
skills, 


b. It was| 
difficult 
to learn| 
to use the’ 


computer. 


Student A StudentB Student C Student D 
(female) (male) 


(male) (female) 


Number of 
books read 
out of class 


By increasing the student’s motivation to engage 
in English language communication rather than 
reinforcing their previous habits of rote-memo- 
rization for better test scores we actually change 
their attitudes toward language learning. To 
fulfill this challenge, we decided to introduce a 
virtual learning environment. One of the advan- 
tages of the environment is that both instructors 
and higher-level students can act as facilitators 
for the lower-level students. Virtual learning 
environments and social networking tools are 
at the cutting edge of today’s trends in hybrid or 
blended learning. In the fall of 2006, the Akita 
Prefectural University CALL lab was updated 
with Intel-based iMac computers with Internet 
connectivity. This allowed us to implement a 
course management system called MOODLE. The 
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Student E StudentF StudentG Student H 
(female) (female) 


word Moodle is actually an acronym for modular 
object-oriented dynamic learning environment. 
Moodle is an open source e-learning platform, a 
free software package designed to help teachers 
and educators create online courses. These e- 
learning systems are sometimes called a learn- 
ing management system, course management 
system, virtual learning environments, education 
via computer-mediated communication or just 
online education (Wikipedia, 2006). Rather than 
switch to MOODLE and abandon seven years of 
work on the JavaScript Hot Potatoes quizzes, this 
cutting edge course management system allows 
for the integration of all the previously developed 
supplemental material into an even wider suite 
of cooperative activities. Since Moodle is based 
on social-constructivism, we have been able to 
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include such new activities as action journals, 
wiki-based assignments, and forums into the 
syllabus to provide channels to the students for 
authentic communicative tasks. 

Beyond the MOODLE learning environment 
we also utilize the integrated iSight Webcam and 
iChat/Bonjeur software that comes standard with 
the iMac to allow our students to conduct group 
work and pair work exercises as a video-confer- 
ence, thus allowing interaction with a much wider 
variety of partners than is usual. MOODLE itself 
supports RSS feeds for podcasts, and we have 
links to ESL specific Internet news sites such as 
VOA and C/NET. These outside resources can 
then provide authentic ‘i+1’ input in the MP3 
format that can be utilized in various coopera- 
tive activities. All of this is part and parcel of 
the current evolution of society in general and 
the Internet in particular. The Web as a tool for 
social constructivism is being referred to as Web 
2.0, a term coined by Tim O’Reilly, of O’Reilly 
Media. He says: 


“... the Web 2.0 meme has become so widespread 
that companies are now pasting it on as a mar- 
keting buzzword, with no real understanding of 
just what it means. The question is particularly 
difficult because many of those buzzword-addicted 
startups are definitely not Web 2.0, while some of 
the applications we identified as Web 2.0, (like 
Napster and BitTorrent, are not even properly 
Web applications!) We began trying to tease out 
the principles that are demonstrated in one way 
or another by the success stories of Web 1.0 and 
by the most interesting of the new applications. 


Like many important concepts, Web 2.0 doesn’t 
have a hard boundary, but rather, a gravitational 
core. You can visualize Web 2.0 as a set of prin- 
ciples and practices that tie together a veritable 
solar system of sites that demonstrate some or all 
of those principles, ata varying distance from that 
core” (O’Reilly, 2005). 


Those parts of the Web 2.0 meme that focus 
on computer-assisted language learning are now 
being referred to as CALL 2.0. 


CONCLUSION 


In conclusion, our study of autonomous learning 
in CALL classes shows that such a practice can 
be utilized most efficiently in a blended-learn- 
ing environment. Using a CALL lab alone will 
probably not have the same beneficial effects as 
those that were proven by the higher than average 
language acquisition the students displayed in a 
six-month period. The results from the survey 
data and interviews showed us that the students 
improved their language proficiency at an ac- 
celerated rate due to the influence of the blended 
learning environment and their self-access to 
materials that we provided at the i+1 level. This 
study also shows the most appropriate method 
for establishing an integrated curriculum utiliz- 
ing CALL is one that employs teachers already 
knowledgeable in CALL who can design a cus- 
tomized lab with both hardware and software 
appropriate to the students’ needs. A blended 
learning environment, which has been focused 
by the idea of learner autonomy, has contributed 
to satisfy the students’ need for improvement in 
the four skills. Most students were eager to use 
computers as an effective tool to improve their 
English skills. The emerging social construction- 
ist Web 2.0 technologies such as open-source 
course Management systems, mobile leaning, 
and podcasting will build upon and enhance an 
already effective system thus allowing students 
even more autonomy in their quest for improved 
English language proficiency. But it must be 
emphasized that the mere introduction of new 
technology alone cannot automatically lead to 
better language acquisition. The act of changing 
the student’s focus from the goal of passing tests to 
the goal of international communication can only 
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occur as an emergent phenomenon when teachers 
facilitate the students in their quest for greater 
autonomy and motivation. The tools provided by 
CALL 2.0, especially VLEs like Moodle, need to 
be skillfully managed by trained professionals to 
have their intended effect. 
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KEY TERMS 


Autonomy: A the capacity to take charge of 
one’s own learning, is seen as a natural product of 
the practice of self-directed learning, or learning 
in which the learners themselves determine the 
objectives, progress and evaluation of learning. 


Blended Learning: The combination of using 
computers and traditional text-based resources in 
the classroom environment. 


Comprehensible Input: New information 
which is still understandable: that is the optimum 
learning environment should provide information 
at the ‘i+ 1’ level, just beyond what the student 
already knows, but which is still understandable 
based on the learner’s background knowledge and 
the context in which it is presented. 


Course Management System (CMS): Also 
called a virtual learning environment, or an e- 
learning system. It is a software system designed 
to facilitate teachers in the management of edu- 
cational courses for their students, especially by 
helping teachers and learners with course admin- 
istration. Both teachers and learners can monitor 
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the system. Though usually considered as a tool 
for distance education, they are often used to 
supplement the face-to-face classroom. 


Hot Potatoes: The Hot Potatoes suite is 
java-script-generating software that enables you 
to create interactive quizzes (multiple-choice, 
short-answer, jumbled-sentence, crossword, 
matching/ordering and gap-fill) for the World 
Wide Web. 


MOODLE: An acronym for modular object- 
oriented dynamic learning environment. Moodle 
is an open source e-learning platform, a software 
package designed to help teachers and educators 
create online courses. 


Podcast: A regular, RSS feed of audio mate- 
rial in MP3 format that can be listened to on an 
iPod or similar device. 


Social Constructionism: A sociological 
theory of knowledge. The focus of social con- 
structionism is to uncover the ways in which 
individuals and groups participate in the creation 
of their perceived reality. It involves looking at 
the ways social phenomena are created, institu- 
tionalized, and made into tradition by humans. 
Socially constructed reality is seen as an ongo- 
ing, dynamic process; reality is re-produced by 
people acting on their interpretations and their 
knowledge of it. 
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Section VI 
Future Directions In 
Language Teaching 


In this section, two chapters describing the use of text-to-speech technology and the use of an audio- 
video chat program in language teaching have been included. The chapter on the use of text-to-speech 
technology is particularly interesting as it has the potential to solve the problem of not having enough 
English native speakers as models in learning English as a foreign language contexts such as Japan. 
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Chapter XXIX 
Applying TTS Technology to 
Foreign Language Teaching 


Junichi Azuma 
University of Marketing and Distribution Sciences, Japan 


ABSTRACT 


This chapter describes how the synthesized English speech sound generated by a commercial TTS engine 
(Pentax “VoiceText”) is utilized within a CALL room environment as well as within the Moodle-based 
e-Learning environment for an EFL class in an average-level Japanese private university. It also argues 
that a TTS synthesized speech material will open a completely new horizon in foreign language teaching, 


implementing a ubiquitous multimedia learning environment at a significantly low cost. 


INTRODUCTION 


We have witnessed an amazingly rapid develop- 
ment in text-to-speech (TTS) synthesis technol- 
ogy past several years. Even in our everyday 
life, we encounter TTS synthesized speech 
when we use the public transportation system, 
vending machines, interactive voice response 
system or automobile navigation system without 
recognizing the existence of the TTS technology. 
A popularly held idea underlying the use of the 
TTS technology is that this technology is meant 
for auxiliary measures. As a matter of fact, TTS 


generated speech is generally considered to be 
a “possible” alternative to human speech only 
within a special and limited environment, and 
very few people regard it to be a “model to be 
learned” by human beings. However, the situa- 
tion has changed dramatically past two or three 
years as the quality of the TTS speech sound is 
beginning to approximate that of the actual hu- 
man speech sound. There are very few reasons 
to reject the idea of using the TTS synthesized 
speech sound as model voices to be presented to 
students in a foreign language class if there is a 
serious difficulty in obtaining an instructor who 
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is a native speaker of the target language or if the 
authentic speech materials recorded by a native 
speaker of the target language are not available. 

In our everyday life, we cannot actually work 
properly without the support of the information 
technology. Our naive view about the information 
technology is that we human beings “control” it 
and “just make use of it.” The fact is, however, our 
own way of thinking and acting is unknowingly 
and deeply influenced by information technology. 
Think of the recent development of search engines 
and map sites, recommendation pages of Amazon. 
com, RSS or the Asian character input method 
of the Microsoft Windows system. We of course 
physically “make use of the information technol- 
ogy,” but it is as if the information technology 
itself were “coming to help us.” 

Though we may still have some kind of 
emotional resistance, the time may have come 
when we can use the TTS synthesized speech 
as a model in educational settings focused on 
the teaching of foreign languages. At the very 
least, we will surely be “communicating” with a 
robot fluently speaking TTS synthesized speech 
within 10 years in our working place. Although 
the present top-level TTS technology produces 
really human-like voices, one should still admit 
that these voices are not perfect and sound like 
somewhat “mechanical.” But if we think of the 
dramatic improvement of the quality of TTS 
engines these two or three years, it will be quite 
probable that an ordinary person will not be able 
to tell the TTS generated speech from the real 
human speech just in 10 years. At that time we 
will have a lot of variety of TTS generated voices 
and most of the languages in the world will have 
a variety of TTS engines of the top quality. The 
application of TTS technology will be really 
unlimited. 

Just about 30 years ago, we thought that robots 
or cyborgs would be a story of the far-distant 
future. But now we have a robot playing a trum- 
pet beautifully. A “cyborg suit” for a physically 
handicapped person or a care worker who has 
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to lift up a sick client is already commercially 
available in Japan (see http://www.cyberdyne.jp/ 
English/index.html). For along time we dreamed 
of flying in the air, but now we have an airplane 
and a helicopter. It seems that almost everything 
we dream of using our brain will never fail to be 
implemented! 

Accepting that TTS technology can be 
applied to foreign language education even today, 
then what are the actual benefits of using TTS 
synthesized speech in foreign language education? 
Below is a list of several concrete benefits of 
using TTS synthesized speech compared with 
the problems of the traditional method of creating 
the recorded speech materials through the analog/ 
digital conversion process. 


Cost Effectiveness 


Since we do not have to hire a native speaker of 
the target language or at least we can reduce the 
number of the teachers who are the native speakers 
of the target language, the cost for the human 
resources canbe reduced. The problem is not only 
the salary. Hiring a foreign instructor often entails 
extra workload for the institute or the municipal 
government and this willalso costa lot. Searching 
for an appropriate foreign instructor, sending staff 
to the country where the applicants live for the 
job interview, assistance in writing documents for 
the application for residence permission, etc., are 
latent costs. Using the TTS synthesized speech 
can dramatically reduce these costs. 

If we ask a native speaker of the target lan- 
guage to record conversations and other materials, 
there will be another cost problem. Suppose that 
we have finished the recording sessions but have 
founda very small mistake a few days later which 
requires another recording session. This will of 
course create another and unexpected cost and 
we cannot assume that the same native speaker 
will again be available for the recording sessions 
at a desired time. 
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Technological Problems Concerning 
Recording 


There are also some technological problems we 
encounter when we record the human voice. The 
quality of the recording equipment truly matters 
and, in addition, input level adjustment is really 
avery difficult but very important factor that will 
determine the overall quality of the recording. We 
mustavoid the saturation caused by the overly high 
levels of input, but if the input level is too low, 
relative noise level will increase. Some record- 
ing equipment such as the minidisk recorder is 
equipped with the Auto Gain Controlsystem. This 
seems to be a very convenient system, but if the 
input level should abruptly change, the resultant 
recording will inevitably be accompanied by 
unnatural fluctuation of the noise level. Especially 
if there is a long period of silence, the noise level 
will dramatically increase, since the system always 
tries to keep the recording level constant. 

Even if the equipment problems are resolved 
and the input level is well controlled, we can never 
expecta high quality recording ifthe environment 
of the recording room is not good. Unless we havea 
recording sessionina professionally soundproofed 
recording room, an optimal recording through 
a microphone is practically impossible. And of 
course the truly desirable professional recording 
room will cost a fortune. Compromises over the 
physical environment of a recording room may 
be reached, but whenever annoying noises come 
from outside, we will need to stop the recording 
and we will be mentally exhausted by the whole 
recording session. 


Native Speakers Are Not Always 
Good Readers 


We tend to think that native speakers of the target 
language, especially if they are teachers, are 


desirable persons to ask for assistance with the 
recording. However, very often the actual speech 
of the native speakers betrays our expectations. 
We must realize that this is quite a natural 
phenomenon, since native speakers working for 
an educational institute are not at all professional 
announcers or professional actors/actresses. 
Sometimes we feel the actual speech is far from 
what we have expected and are tempted to stop 
the recording sessions to ask the native speaker 
to speak as we wish. But if we really stop the 
recording session and give instructions to the 
native speaker to utter the script in a more proper 
manner, we will be inevitably confronted with 
the furious look of the speaker, or at the very 
least, a very puzzled look. The speaker simply 
does not understand why he/she should be given 
instructions on proper manner of reading by a 
non-native speaker of the target language while 
he/she was asked to come for the recording 
sessions. This is really a miserable situation, but 
we will encounter such problems as long as we ask 
native speakers to record the speech for creating 
educational materials. 


Complicated Editing Process 


Evenifthe recording sessions were successful, we 
muststill anticipate acomplicated editing process. 
First, we must input the recorded material into 
a computer. If we can handle all this digitally it 
would not be so difficult, but if we have to convert 
analog sound material we must control the process 
and the input level very carefully. Needless to 
say, the quality of the converted sound depends 
on the quality of the sound card of a computer. If 
it is not of a good quality, the resultant recording 
may be contaminated with a lot of unnecessary 
noise caused by the computer, which itself is a 
digital noise generator in a sense. 
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Figure 1. Text input field of Globalvoice English (© 2007, Voiceware Co., Ltd. Used with permission) 
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development, it has a strong focus on partnership and networks of exchange of experience. 


A total of 5046.5 million for the period 2000-2006 will be spent, of which 2105.1 million is funded by 
the EAGGF Guidance section and the remainder by public and private contributions. 
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CREATING TTS SYNTHESIZED 
SPEECH MATERIAL FOR 
LANGUAGE TEACHING 


General View of TTS System Used 
for the Study 


If we use TTS synthesized speech, most of the 
difficulties mentioned above will be resolved. 
All processes of the speech material production 
are done with a computer and everything will 
be quite simple. An educator merely types the 
script and then just one click will generate a 
WAV format sound file. For example, the author 
currently uses the TTS system called VoiceText 
offered by Pentax. As youcan see in Figure 1, just 
clicking the Read Aloud key (with “>” icon) after 
typing the script will generate a TTS synthesized 
utterance. By clicking Synthesize and Save 
key (with the “bag and speaker” icon), then the 
synthesized speech will be saved as a WAV file. 
The sound quality of VoiceText is really superb 
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Synthesize And Save key 
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and the author’s students did not recognize that 
they had heard synthesized speech until they 
were told so. 

VoiceText accepts some special tags that will 
locally control some prosodic features of an utter- 
ance. Some of the useful tags are as follows: 


a. <vt_pitch>: Tag to change the relative 
height of the fundamental frequency of the 
selected area 

b. | <vt_speed>: Tag to change the relative 
speed of the selected area 

c. <vt_volume>: Tag to change the relative 
loudness of the selected area 

d. <vt_pause>: Tag to insert the desired 
duration of a pause at a desired place 


If we want to modify some prosodic features 
of the total utterance to be synthesized, these 
can be easily implemented through a GUI menu. 
Due to these features, flexible speech synthesis 
is possible using this software. 
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Figure 2. Setting the preference menu of Globalvoice English (© 2007, Voiceware Co., Ltd. Used with 
permission) 
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Figure 3. Tags for local prosodic control (© 2007, Voiceware Co., Ltd. Used with permission) 
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Actual User Interface of TTS 
Software 


The TTS engine used for this study is called 
“VoiceText” released by Pentax Co. inJapan. The 
actual name of the software used is “Globalvoice 
English” with one male voice of American English 
and one female American English voice. The 
software not only reads the text aloud typed in 
the relevant input field but also can save the sound 
output as a WAV file. Figure | shows the actual 
text input field. The prosodic features, such as 
overall pitch level or overall speed of the utterance, 
can be modified using the preference menu as 
shown in Figure 2. If we judge the speed of the 
speech is too fast for our class, we can adjust the 
whole speed of the utterance and make the speech 
much slower using the preference menu. 

There are two options for the further editing 
tasks. One method is to edit the generated WAV 
file using appropriate sound editing software such 
as Audacity (URL: http: // audacity. sourceforge. 
net/) or Wavesurfer (URL: http: // www. speech. 
kth. se/ wavesurfer/). The other way is to continue 
the editing task using the Globalvoice English 
software, without leaving its text input field. For 
example, if we would like to have the spoken text 
repeated three times, we can just paste the nec- 
essary script three times on the text input field. 
When we want to set a pause at a certain phrase 
boundary, we can just insert “,” (a comma) there 
and then the software will automatically set a 
short pause at that point. The speech material can 
be saved as a WAV file after these rough editing 
tasks are finished and if necessary, we can further 
continue more detailed editing work using some 
sound editing software. 

We may be very often tempted to add more 
prosodic variety to the speech sound generated 
by Globalvoice English. In such cases, the local 
modification of certain prosodic features is pos- 
sible by using the tags. As shown in Figure 3, we 
can add necessary tags to the place where we would 
like to have certain prosodic effects and then the 
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software will modify the prosodic features at that 
point only. Prosody is not only important in total 
recognition process of the human speech (Ozeki, 
2005) but it also reflects and disambiguates the 
syntactic structure (Azuma & Tsukuma, 1991, 
Lehiste, 1977) of a phrase and sentence. Because 
of this, local control of prosodic features is one 
of the indispensable features of the TTS speech 
synthesis software. 

Honestly speaking, Pentax Globalvoice 
English is not the only one TTS software that 
can be used for teaching English as a foreign 
language today. For example, Cepstral Voice 
is a good option, since they offer 13 American 
English voices andtwo British English voices. The 
voice quality may not be as good as Globalvoice 
English, but their pricing is quite reasonable and 
each voice has versions not only for Windows 
but also for Mac OS X, Linux and Solaris. The 
license for the use of the synthesized voice is not 
so complicated. The URL of Cepstral Voice is 
http://www.cepstral.com/ and the demo page is 
http://www.cepstral.com/demos/. 

Another option of the TTS software suitable 
for English teaching is AT&T Natural Voices. 
This series offers 5 American English voices 
and two British English voices. There are many 
commercial products using AT&T Natural Voices 
but the products offered at ReadPlease seem to 
be easy to handle. One of the products called 
“ReadingBar 2 for Internet Explorer” can read 
the Web page and record the synthesized voice 
to sound files (WAV or MP3 files). The pricing 
is quite reasonable but you must also buy the 
necessary version of Natural Voices TTS engine. 
But still the total cost will not be such a big 
problem. The URL of ReadPlease is http://www. 
readplease.com/. 

Please remember that even at the demo site 
of AT&T Natural Voices, you can synthesize the 
English voice and save it as a WAV file, though 
this is possible for just a small amount of speech 
atone time. This demo site, http://public.research. 
att.com/~TTSweb/TTS/demo.php, of course 
restricts the use of the synthesized speech file but 
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its faq page says just asmall amount of the usage 
at an educational environment will be possible 
(“A class project is probably OK. Bugging your 
friends is probably OK (with us). A game level 
released on the internet is not OK. Using TTS for 
song lyrics and releasing a CD is not OK. Build- 
ing or prototyping a software package using our 
audio rather than recording your own recorded 
prompts is not OK.” For details, see http://public. 
research.att.com/~TTSweb/TTS/faq.php). This 
faq page also offers simple tips for the tags for 
the local prosodic control, while the detailed 
explanation concerning the text markup tags is 
offered at http://www.naturalvoices.att.com/sup- 
port/ATT Natural VoicesTTS14.pdf. 


MULTIMEDIA ENVIRONMENT OF 
LANGUAGE TEACHING 


TTS synthesized speech materials can be used in 
various kinds of language teaching environments. 
Teachers can take a laptop with them to their class- 


room and present the sound materials through an 
appropriate PA system. Orthe synthesized speech 
materials can be recorded onto a minidisk or a 
cassette audiotape so that the speech materials can 
be easily used through a traditional audio system. 
However, amuch more effective way of using the 
TTS synthesized speech materials for language 
teaching is to use them in a so-called “CALL” 
environment, or in an e-Learning environment. 
The following describes how the author makes 
use of the TTS synthesized speech materials in 
the actual teaching environment. 


Actual Environment where TTS 
Synthesized Speech is Used 


A newly renovated CALL room (“WeLL” system 
developed by JVC) was allotted for the author’s 
2006 class of “English Business Communication” 
at University of Marketing and Distribution Sci- 
ences, Kobe, Japan. The teaching material adopted 
is BIG CITY (Oxford University Press) Level 1. 

During the class, students are told to attempt 


Figure 4. Recording through software recorder (© 2007, Victor Company of Japan, Ltd. Used with 


permission) 
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several small-scale speaking-oriented activities, 
such as conversation practice, oral presentation, 
shadowing (i.e., trying to imitate the utterance 
orally while listening to the model speech), etc. 
For these speaking-oriented exercises, TTS 
synthesized materials generated by Globalvoice 
English are mainly used, since it is possible 
to create native-like speech sound quite easily 
without the help of native speakers of English. 
A videotape accompanies the textbook, but the 
speed of recorded materials is normally too fast 
for the students to follow. The video was recorded 
in an authentic situation and because of the sound 
effects (i.e., noise of the street or the restaurant), it 
is a little difficult for the students to concentrate 
on the English utterance only, though these 
effects really give them authentic atmosphere in 
the situation where the conversation is supposed 
to be taking place. 

The synthesized materials are stored as WAV 
files on the server of the CALL room and they 
are distributed to students in the form of “stream- 


Figure 5. Conversation practice page of Moodle 


ing” through the software called “Software 
Recorder” that comes with the CALL system. 
For example, students can enjoy the shadowing 
practice following the TTS model voice and they 
can record their voice by themselves to compare 
the features of the model voice and their own 
utterance (see Figure 4). Students can record their 
speechas many times as they like andif they judge 
their recorded speech is good enough, they can 
submit the recorded WAV file to the teacher by 
clicking the “Submission” switch of the Software 
Recorder (See Figure 4). This action will transfer 
the students’ sound files to the instructor’s server 
in the CALL room. 

In order to support students’ learning activi- 
ties after the class, a Moodle e-Learning site is 
also offered. The same oral exercise materials 
as used during the class are encoded into MP3 
format and stored on the Moodle server so that 
the students can retry the exercises even at home. 
Figure 5 shows the author’s actual Moodle page 
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for the conversation exercise. 

Teachers may normally upload an MP3 file 
within a certain material storage folder of the 
Moodle site and set a hyperlink to the MP3 file 
when publishing a page for listening practice 
or shadowing exercise. Just setting a hyperlink 
to the relevant MP3 file will automatically cre- 
ate the PLAY/STOP switches and enable the 
Flash streaming. No programming or coding is 
required. 

During the next class period, students can be 
requested to record their utterances in the WAV 
format using the Software Recorder of the client 
computer of the CALL system. Students’ WAV 
files can be sent to the instructor’s server and 
the instructors can take the files away to their 
office and evaluate each student’s utterance. The 
evaluation of the utterance is uploaded onto each 
student’s space of the Moodle site. 


CONCLUSION 


During the analog age, sound materials or video 
materials were quite difficult to produce and com- 
pile. Naturally, reuse of these materials was nearly 
impossible unless one was really prepared for an 
enormously laborious task. However, owing tothe 
rapid development of the information technology, 
handling of these multimedia materials is 
becoming easier and easier every year. Once the 
sound or video materials are digitalized, they can 
be handled as easily as a simple text file. These 
materials can be easily manipulated as learning 
objects to be part of a larger multimedia learning 
unit and can be dynamically applied to various 
types of educational environment. 

The impact of the TTS technology lies in the 
ease with which people can generate the speech 
sound directly from the script on the spot. Reuse 
and sharing of the text information through the 
Internet was truly a revolution. However, as we 
type ina letter using a keyboard of acomputer, our 
idea is instantly digitalized in a sense. Because 


of this, as argued by the author (Azuma 2006), 
the digitalization process of the text materials is 
not actually a difficult one when compared with 
the digitalization of analog sound material. What 
is superb about the TTS technology is that it can 
skip the complicated process of the analog/digital 
conversion and create the sound file seemingly 
direct from the text input. 

In the age of Web 2.0, where the openness, 
content aggregation and efficient learning object 
retrieval are supposed to create a completely 
new network society (see Alexander, 2006), 
the proper handling of multimedia files will 
dramatically increase the value of the network. 
TTS technology is believed to contribute to the 
establishment of the new era of the multimedia 
content aggregation through its capability of easy 
and quick production of the speech sound. You 
can start the podcasting or the Internet radio 
service even without expensive recording facilities 
if you use an appropriate TTS system! Without 
doubt, it will greatly contribute to the discipline 
of foreign language teaching in the multimedia- 
based ubiquitous communication age. 
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KEY TERMS 


Content Aggregation: Collecting data from 
various sources, and making it available in a 
seemingly single Web page. 


Moodle: A very popular open source course 
management system for e-learning. 


TTS: Acronym for Test-To-Speech. The sys- 
tem which converts normal text into artificially 
generated speech sound. 


Web 2.0: Today’s new type of Web-based 
communities and services where collaboration, 
content sharing and content aggregation are 
implemented on a huge scale. This phrase was 
originally coined by O’Reilly Media. 
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Chapter XXX 
Using an Audio-Video Chat 
Program in Language Learning 


Yuko Kinoshita 
University of Canberra, Australia 


ABSTRACT 


This chapter presents a descriptive report on a video chat project undertaken in early 2006 at the 
University of Canberra, Australia using iChat. Video chat enables two or more people with personal 
computers and broadband Internet connections to ‘chat’ with audio and video so they are visible to each 
other, in real time, almost as though in face to face communication. This project aimed to provide L2 
learners opportunities to practice speaking with and listening to native speakers of the target language 
and experience real-life communication in the target language. The report contains a detailed account 
of the methodology and observations made on student behaviour and motivation during the project. 
Students participated enthusiastically in the project and seemed to be highly motivated to use iChat to 
communicate with native speakers of Japanese in Japan. The project showed that there is great potential 
for video chat as a language learning tool. 


INTRODUCTION 


This project was designed as a teaching project 
rather than a research experiment and thus this 


This chapter is areport of the use of Internet-based 
video conferencing (‘video chat’) in a language 
classroom. This project took place between Aichi 
Shukutoku University (ASU) in Japan and the 
University of Canberra (UC) in Australia in May 
2006 over four sessions for a total of eight hours. 


paper does not claim to be an empirical study. 
The project, however, introduced a relatively 
new technology into the classroom and there- 
fore can contribute to our understanding of how 
such technology can benefit language learners. 
Although many consumer video conferencing 
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tools are available on the market (iChat, Skype, 
MSN Messenger and so on), literature on the use 
of such tools is still scarce. Therefore, a detailed 
report on the use of video conferencing tools for 
language learning may be useful for those who are 
considering incorporating it into their teaching. 
This paper aims to share as much information as 
possible on this particular project and to reflect 
on the observations made. 


COMMUNICATION ON THE 
INTERNET 


Inrecent years, computer technology has become 
much more accessible to a broad spectrum of the 
population in many countries. Both teachers and 
learners generally have easy access to computers 
and, consequently, computers are now much more 
widely used in the classroom than was previously 
the case. Technology has been used in the class- 
room to assist language teaching and learning in 
many ways, such as multimedia presentations of 
teaching material, self-study programs, quizzes 
and accessing an abundance of authentic materials 
via the Internet. 

The project reported in this chapter, however, 
focuses on the value of these technologies as 
tools of communication and social interaction 
to facilitate language learning. With e-mail ad- 
dresses and computer access at their universities, 
most learners can communicate with people in 
most parts of the world very cheaply and quickly. 
Internet-based audio communication, such as 
Skype, allows learners to talk with people on 
the other side of the earth at a very low cost to 
the consumer. 

For some time now, the potential of computer 
mediated communication (CMC) has been ex- 
plored in the language classroom situation (for 
instance, see Warschauer, 1997). This technology 
has great potential to assist language learners, 
particularly those who live and study outside 
the community in which the target language 
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is spoken. Typically, these learners have much 
less opportunity to use the target language and 
to interact with native speakers than those who 
visit a country where the language is spoken. 
Therefore, the benefit of being able to communi- 
cate with native speakers via technology would 
be significant. 


Text-Based CMC 


The use of CMC in language learning can be clas- 
sified broadly into three kinds, depending on the 
mode of communication: text-based CMC, audio- 
based CMC and audio-visual CMC. Text-based 
CMC was the first to become widely used in the 
classroom. There are both synchronous written 
communications, such as text chat, and asynchro- 
nous such as bulletin boards and e-mail. Both 
modes of text-based CMC give learners time to 
plan the expression of thoughts and time to analyse 
their linguistic production retrospectively after the 
chatting sessions. Kern (1995), from the results of 
his experiment on synchronous text-based CMC, 
suggested that text-based CMC could reduce 
learner’s anxiety and increase their motivation, 
thus resulting in more active participation from 
quiet learners who usually choose not to partici- 
pate during face-to-face whole class oral discus- 
sions. Kitade (2000) also reports positive effects 
from the use of text-based chat in the language 
classroom. She observed that it “facilitates col- 
laborative and comprehensible interaction while 
providing individual learners an opportunity for 
learner-centred interaction” (p. 163) 

However, there are some criticisms of this 
mode of text-based CMC. In his review on re- 
search related to such technologies, Salaberry 
(2005) points out that text-based CMC leaves out 
significant information that plays a vital role in 
face-to-face interactions. Audiovisual informa- 
tion, such as facial expressions, tone of voice 
and body language, are not available through 
text-based CMC; yet suchnon-verbal information 
is crucial for successful communication in face- 
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to-face interactions. Thus, if we envisage using 
text-based CMC to develop the skills that are 
required in normal face-to-face interactions, this 
medium falls short of our expectations. Further- 
more, in a text-based CMC chat, learners do not 
need to negotiate turn-taking, because overlaps 
and interruptions are not possible in this mode 
of communication. Consequently, heavy reliance 
on these technologies could hinder the learners’ 
development in the turn-taking skills that are 
needed for face-to-face interactions. 

In addition, the target language sentences 
produced by learners in text-based CMC may not 
be useful for the development of standard writ- 
ten language. Kitade (2000) points out that the 
sentence structures used in text-based CMC share 
“some features with verbal interaction eventhough 
it is text-based” (p. 147). This, together with the 
turn-taking issues discussed above, suggests that 
communications in synchronous text language 
use skills and strategies something in between 
of purely spoken or written delivery. 

Although e-mail and text chat are becoming 
increasingly popular, they are still a small part 
of daily communication for many. Frequently, 
intermediate learners of Japanese struggle to 
differentiate the two different styles and sets of 
vocabularies used in spoken and formal written 
language, so the introduction of this third mode 
may simply increase the stress in learning. Kern 
(1995) expressed a further concern noting that 
text-based CMC may be responsible for learners’ 
grammatical inaccuracies and errors. During 
text-based CMC classes in French, he observed 
that many grammatically ill-formed sentence 
structures were used, presumably because the 
speed of communication did not allow for correc- 
tion of grammar. He was concerned that the input 
provided to other learners, communications from 
which they were supposed to learn, also contained 
those same ill-formed sentences. 

Text-based CMC may have a positive effect 
on the learners’ motivation and enthusiasm and 


this should not be overlooked. However, its in- 
troduction to the classroom needs to be done in 
a measured way with much consideration of the 
competency of the learners, the nature of their 
partners (e.g., native speakers or fellow learners) 
and whether the learners’ needs are met by the 
technology. If simple written communication is 
still a struggle for the learners, text-based CMC 
may not be an effective exercise for them. 


Audio-Based CMC 


In recent years, due to the availability of faster 
telecommunication networks, faster computers, 
and better software, audio-based CMC has be- 
come a viable alternative to text-based CMC. This 
mode of communication overcomes some of the 
problems associated with text-based communica- 
tion such as the lack of turn-taking and lack of 
audio information such as the tone of voice and 
prosodic features of speech. However, learners 
still do not have access to other useful informa- 
tion suchas facial expressions and body language. 
The absence of visual cues from the interlocutor 
makes oral communication much more different 
from, and more difficult than, normal face to face 
speech—in much the same way as we occasion- 
ally find with telephone conversations even in 
our native language. 

As well as changing some aspects of the 
language used, it makes learners more anxious 
although as Larsen-Freeman and Long (1991) 
point out anxiety does not necessarily hinder the 
learning process. Alpert and Haber (1960) clas- 
sified anxiety into two categories: debilitating 
and facilitating anxiety. Reduction of debilitating 
anxiety or stimulation of facilitating anxiety which 
could enhance motivation. Studies examining 
language anxiety and speaking (Cheng, 1998; 
Clément, Gardner, & Smythe, 1980; Clément & 
Kruidenier, 1985; Cohen & Norst, 1989; Daly & 
Wilson, 1983; MacIntyre, Noels, & Clément, 1997; 
Price, 1991) have consistently found that high 
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levels of language anxiety and lowself-perception 
of competence contribute to low self-confidence 
and unwillingness to communicate. 


Audio-Visual Based CMC 


Faster Internet access and more powerful desktop 
computers have also made audio-visual CMC, that 
is, Internet video conferencing or ‘video chat,’ 
a viable option as a classroom activity. Unlike 
audio-based CMC, video chat allows learners to 
have more complete experiences of verbal com- 
munication in the target language. The visual 
component provides them with the previously 
missing extra-linguistic information suchas facial 
expression and body language. 

Although theoretically learners might have 
similar experiences in audio-visual CMC as 
in face-to-face interactions, there are some 
limitations. First of all, the learners still do not 
experience actual physical contact. This could be 
an important part of communication in certain 
cultures. Although, for many cultures, such as 
Japanese, there is little cost to the authenticity 
of their experiences since they do not involve 
bodily contact as part of their communication 
system in the first place. Secondly, visual cues, 
such as eye contact and facial expressions, might 
not be noticed as each participant is looking at 
their screen rather than directly at the camera. 
Thirdly, video chat is usually set up to give a 
view of the speakers’ faces only, or perhaps head 
and shoulders, and thus non-facial gestures will 
be missing. Finally, the quality of the video can 
also affect communication particularly if the 
frame rate and synchronization of the video with 
audio do not allow enough resolution and time 
alignment between sound and facial movements. 
However, even with these limitations, video chat 
still offers opportunities for learners to practice 
their speaking skills. 

The “iChat project” was developed to explore 
the potential of Internet-based video conferencing 
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technology for language learning as a comple- 
mentary source of authentic communication 
experience for foreign language learners. It was 
intended to be a medium in which they stretched 
their ability to communicate orally in the target 
languages. 


BACKGROUND 
Motivation for the iChat Project 


The ‘iChat project’ was conceived by lecturers 
at ASU in Japan and the author in the Japanese 
program at UC in Australia in mid 2005. It was 
implemented with the assistance of the Technical 
Services Unit in the Division of Communication 
and Education at UC, and the equivalent unit at 
ASU. In the project, it was intended to establish 
Internet-based video conferencing between 
students learning Japanese at UC in Australia 
and students learning English at ASU in Japan 
using the Apple software, ‘iChat’ (http://www. 
apple.com). This consumer software enables a 
standard desktop or laptop computer to act as a 
videophone or videoconferencing device with a 
simple interface for the end user. 

Actively engaging language learners in oral 
communication practice, such as a discussion in 
the target language, has always been challeng- 
ing. Although learners are acutely aware that 
oral communication practice is an essential part 
of language learning, many of them hesitate in 
speaking the target language during classroom 
discussions. Some language learners actively 
avoid speaking in class. 

Cheng, Horwitz, and Schallert (1999) claim 
that classroom anxiety has a strong speaking 
anxiety element. Horwitz, Horwitz, and Cope 
(1986) and MacIntyre and Gardner (1991) sup- 
port this view, citing listening and speaking as 
the main sources of anxiety for students. Young 
(1991) lists some obvious manifestations of this 
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anxiety that include “the form of distortion of 
sounds, inability to reproduce the intonation 
and rhythm of the language, ‘freezing up’ when 
called on to perform, and forgetting words or 
phrases just learned or simply refusing to speak 
orremaining silent” (p. 430). Horwitz et al. (1986) 
and Schlenker and Leary (1985) believe that 
the frustration faced by students attempting to 
communicate leads to apprehension about future 
attempts to participate. 

In Australia at least, language programs 
in primary and secondary schools place more 
emphasis on communicative skills and fostering 
learners’ interest and affinity for the language 
and culture with grammatical accuracy often 
overlooked (Spence-Brown & Hagino, 2006). In 
the tertiary level language classroom, however, 
learners are expected to develop a competency 
in the four macro-skills even though available 
face-to-face teaching hours are very limited (usu- 
ally four face-to-face contact hours per week at 
the intermediate or advanced levels). Therefore, 
in order to develop learners’ ability to express 
complex ideas, a significant amount of time is 
spent on grammar instruction. In addition, for 
Asian languages, such as Japanese or Chinese, 
learners must spend considerable time on learn- 
ing the meanings and usage of characters. For 
instance, in the program at UC, they are expected 
to learn about 300 kanji characters in their first 
two years as well as the two types of Japanese 
phonetic scripts, hiragana and katakana. In third 
and fourth years, they are expected to learn a 
further 500 or more kanji (Chinese characters). 
Under suchcircumstances, itis difficult to allocate 
enough time for oral communication practice in 
the classroom. Finding more efficient ways of 
developing learners’ confidence in speaking the 
target language is essential. 


Effectiveness of Video Conferencing 


For any conscientious teacher, finding practi- 
cal new ways of improving their teaching is an 


exciting challenge. Computer assisted language 
teaching was enthusiastically embraced by many 
precisely for that reason. The results, however, 
have not always been positive as sometimes the 
technology was used just because it was available 
without appropriate pedagogical consideration. 
Salaberry (2005) stresses the importance of 
identifying “the pedagogical objective that tech- 
nology-based teaching is intended to fulfill” (p. 
81) and suggests that four major questions should 
be asked when integrating computer technology 
into a language curriculum: 


° “Ts increased technological sophistication 
correlated to increased pedagogical effec- 
tiveness?” 

° “Which technical attributes specific to new 


technologies can be profitably exploited for 
pedagogical purposes?” 


. “How can new technologies be successfully 
integrated into the curriculum?” 

* — “Do new technologies provide for an effi- 
cient use of human and material resources?” 
(p.82) 


In this section, the development of the iChat 
project is examined in light of these questions. 

With respect to the first question, Salaberry 
(2005) notes that the introduction of new technol- 
ogy inthe classroom often risks teachers slipping 
away from an approach based on pedagogical 
principles and falling into a technology-driven 
one. The newness of the technology can sometimes 
be confused with its effectiveness. 

The iChat project was conceived and developed 
to increase opportunities for learners of Japanese 
as a foreign language in Australiato communicate 
orally with Japanese native speakers who are also 
learners of English asa foreign language in Japan. 
Since bringing native speakers into the classroom 
is often difficult, video conferencing seemed to 
be a practical alternative way to fill this need. 
However, the question still remained: can video 
chatting be really useful in developing the neces- 
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sary skills for face-to-face oral communication? 
Nunan (1989) lists crucial competencies required 
in successful oral communication: 


. The ability to articulate phonological fea- 
tures of the language comprehensibly; 

. Mastery of stress, rhythm, intonation pat- 
terns; 

° An acceptable degree of fluency; 

. Transactional and interpersonal skills; 

° Skills in taking short and long speaking 
turns; 

. Skills in the management of interaction; 

. Skills in negotiating meaning; 

. Conversational listening skills (successful 
conversations require good listeners as well 
as good speakers); 

. Skills in knowing about and negotiating 
purposes for conversations; 

. Using appropriate conversational formulae 
and fillers (p. 32). 


The first three skills can be developed in the 
conventional language classroom with appropriate 
guidance from the instructor. In fact, these skills 
may very well be better developed under careful 
observation and assistance from the instructor 
than by having a continuous conversation. In a 
continuous conversation, such as in audio-visual 
CMC, the focus of conversation is usually placed 
on communicating meaning and understanding 
each other’s intent, so that appropriate feedback 
might not be offered by the interlocutors. A con- 
versation is a social and cooperative enterprise. 
The native speaker would thus try to fill any in- 
formation gap created by the imperfect use of the 
language by the other speaker. In addition, offering 
useful feedback on their conversation partner’s 
pronunciation problems is a specific competency. 
Without having some degree of education and 
training, usually it is quite a difficult task. 

Other skills are, however, more difficult to 
attain without engaging in actual face-to-face 
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oral communication as they are used in very fluid 
contexts. Practicing the rest of skills mentioned 
outside of the contexts is nearly pointless and 
perhaps impossible. 

Returning to the problem of language anxiety, 
video chat could be useful for this purpose but only 
if the audio-visual CMC context helps learners 
become less anxious and thus more confident to 
practice speaking. 

Now we turn to Salaberry’s second question: 
which technical attributes of video chat can be 
pedagogically useful? The most significant dif- 
ference between video chat and text- and audio- 
based CMC is in the availability of real-time 
audiovisual information. Therefore, video chat 
technology may be a useful pedagogical tool to 
supplement classroom teaching and other types of 
CMC. Language learners, theoretically, can gain 
discourse level skills such as turn taking from 
audio-visual CMC provided the time resolution, 
pixel resolution and audio-visual synchronization 
are adequate. 

The third question was: how well can this tech- 
nology be integrated into the curriculum? During 
the iChat project, the learners were engaged in a 
free-form conversation with their partners without 
any intervention from the teachers. Thus, they did 
not receive corrections on form and were unlikely 
to learn new structures. The focus was on com- 
munication rather than accuracy. Further, what 
the learners gained in the video chat sessions was 
unlikely to be helpful in developing their reading 
or writing skills. This should not be of concern, 
however, if this activity is integrated into a part of 
a well balanced curriculum. A video chat session 
could be integrated into the curriculum by con- 
necting it with other tasks such as writing tasks 
related to the topics before or after the session. 

The last question is whether new technologies 
are efficient in terms of the use of human and ma- 
terial resources. In the iChat project, we teamed 
up two groups of learners who wanted to learn 
each other’s language. The learners from Japan 
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and Australia participated in the project as a part 
of a formal course. While there were significant 
human resources in adjusting the computer net- 
work settings at the two universities, there were no 
special resources used to carry out the project. It 
was also very efficient in terms of materials since 
the iChat program is contained within the normal 
set up of standard Macintosh computers and both 
software and hardware already existed in the both 
universities’ laboratory infrastructure. 


THE PROJECT 
Setup of the Project 


In both participating universities, the iChat ses- 
sions were held during formal class time and 
participation in these sessions was built into the 
assessments of the courses to ensure learners’ 
commitment. In Australia, third year learners 
participated as a part of the year-long ‘Japanese 
Language 3’ unit, whereas ASU in Japan con- 
ducted a short intensive module ‘Get Together and 
Talk,’ which was available as an accredited unit 
in all courses at the university. These two units 
were scheduled at the same time of the day on the 
same days of the week. The small time difference 
(one hour) between Japan and Australia made the 
negotiation of time easier than it would have been 
if other countries had been involved. However, 
as the universities operate under two different 
academic systems, the negotiation of the common 
dates was more difficult than anticipated. In the 
end a series of dates in May were chosen for four 
classes of two hours each, a total of eight hours. 


Participants 


At UC, 14 third-year learners of Japanese partici- 
pated in the project, seven male and seven female. 
Most were in the age range 19 to 22 years, plus 
two mature aged learners in their late twenties 
and thirties. Although enrolled in the same unit, 


the Japanese language proficiency of the learners 
varied greatly. Two had very high proficiency in 
the four macro-skills but 12 struggled to express 
their views in Japanese prior to this project. It is 
estimated that most students would be between 
Level 2 and 3 but closer to Level 3 using the 
standardized Japanese Language Proficiency 
Test. (This test is run by Japan Educational Ex- 
changes and Service. For more information, see 
http://www.jees.or.jp/jlpt/en/index.htm) 

At ASU, 17 learners of English participated 
in the project, four male and 13 female. All were 
around 20-21 years old. Most of them were 
third-year students with two from fourth year. 
Although they had been studying English for at 
least six years in the secondary education system 
and hence had better reading and writing skills 
than their Australian partners, most had not re- 
ceived much training in oral/aural skills. They, 
too, often struggled with, or were unwilling to 
discuss, complex issues in the target language, 
showing a similar effective level of proficiency 
in English to the Japanese proficiency of their 
Australian counterparts. 


Discussion Topics 


Topics for discussion were pre-selected by the 
teaching staff prior to each session. The pre-se- 
lection served two functions. Firstly, it allowed 
learners to prepare for the discussions. This was 
particularly important for the learners of Japanese 
at UC due to their limited vocabulary. Without 
preparation, they would not have been able to 
discuss a complex issue with any sense of flow. 
Secondly, it gives the session more focus and depth 
of content. If left to chat freely, learners tend to 
resort to simple general conversations within their 
current vocabulary; they do not spontaneously talk 
about complex issues in the target language. 
The topics chosen were to be contentious for 
the learners so that their use of the target language 
would be extended not just in basic vocabulary 
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and communication but also in expression of 
reasoned arguments and emotion: 


1. The death penalty 

2. Article Number 9 of the Japanese constitu- 
tion—“The renunciation of war” 

3. Marriage between same sex couples 

4. Should each country accept more refu- 
gees? 


UC learners were provided with handouts 
containing readings in Japanese for each topic 
at the beginning of the semester, more than two 
months prior to the iChat sessions. These read- 
ing handouts were created for two purposes: to 
provide learners some examples of the relevant 
vocabularies embedded in the contexts; and to 
stimulate learners’ thoughts on the issues. For 
the second topic, an English translation was also 
given since the legal language in this article was 
beyond learners’ vocabulary knowledge. 

As the topics were linguistically and intellectu- 
ally challenging for learners in both Universities, 
class time was also spent to prepare for the dis- 
cussion prior to the iChat sessions. The learners 
at UC were required to prepare a short written 
commentary and a vocabulary list on each topic 
before the sessions. In addition, learners were 
given an assignment of writing a composition on 
the first topic in late April, 2006. 

It was hoped that these tasks would create 
opportunities for learners to train themselves in 
explaining their views, listening to and under- 
standing others’ ideas, comparing and critically 
analyzing the different point of views, re-evalu- 
ating their positions and expressing such things 
orally in the target language. Writing up their 
views and opinions in Japanese helped them to 
prepare for the face-to-face discussion with native 
speakers of Japanese in the first iChat session. 
After the sessions, they submitted these as a part 
of their assessments. 
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Facilities and Equipment 
Network Safety Issues 


In order for this project to take place, numerous 
technical issues needed to be dealt with. While 
iChat is a fairly mature technology for consum- 
ers, it is challenging to make it work between 
university computer networks. Every institution 
is likely to have a different network topology and 
firewallrules. Therefore, it was expected that some 
network engineering for both universities would 
be required in order to make Internet based video 
conferencing work. In this section, the problems 
we encountered in setting up the project and the 
corresponding solutions are described. 

As this was the first use of the technology in 
the language programs at both universities, we 
allowed ourselves five months of lead-up time 
between the commencement of the project and 
actual learner participation. In addition, several 
experiments to ensure the video conferencing was 
working at a satisfactory level were undertaken. 
Sound and video quality and stability of the net- 
work were our obvious concerns. 

During the initial experiment, it was dis- 
covered that only text-based chat could be used 
because of the network security configurations. 
Although audio-based communication tools such 
as Skype were working, iChat could not be used 
because of its different communication technol- 
ogy. Our preliminary investigations revealed that 
the firewall settings on the UC network were caus- 
ing this problem. UC network administrators were 
particularly concerned with opening the necessary 
ports in the firewall for fear of compromising 
overall network security at the university. 

After much negotiation and research by the 
technical support staff, the university opened up 
a special segment of the network which was not 
subject to the protection of the university firewall, 
on the proviso that only Macintosh computers 
would be connected. Since Macintosh computers 
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are not subject to the same level of malware at- 
tacks as Windows computers, it was recognized 
that there would be a much reduced risk of the 
computers being compromised and possibly af- 
fecting others on the UC network. 


Hardware 


Each university used computer laboratory 
equipped with Apple iMac G5 computers and 
ASU had two additional more powerful Mac- 
Book Pro computers as well. At UC there were 8 
iMAC G5 computers. Since there were not enough 
computers available, most UC learners shared a 
computer with a fellow learner. Two headphones 
and microphones were connected to each computer 
using an ‘iMic’ headphone splitter so that both 
could talk and listen at the same time. 

Each ofthe ASU learners in Japan, on the other 
hand, had their own computer. Originally, it was 
planned to invite multiple computers to chat, thus 
enabling not only one on one communication but 
also one to many communication so that we can 


address the problem of the numbers of learners in 
two universities not being balanced (14 learners 
on eight computers from UC and 17 from ASU). 
However, we discovered that this was technically 
difficult and that one-to-many video iChat was 
only effective with the more powerful computers. 
Inpractice, while two pairs of students at UC chat- 
ted to three ASU students each using MacBook 
Pro, other pairs of learners at UC chatted to one 
ASU student in Japan using iMac G5 computers. 
Consequently, only 12 ASU learners could chat at 
one time. The remaining five ASU learners had 
to take turns to participate in the chat. Figure 1 
illustrates the setup. The small rectangles show 
computers used in this project, small circles with 
‘S’ indicates students, and large arrows show 
where the video chat was taking place. 


Sessions 
Once the sessions began, everything went very 


smoothly. The interfacing and operating of the 
software was very easy even though none of the 


Figure 1. A diagrammatical representation of the session setup 
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UC learners had used the software before. A 
questionnaire at the end of the project indicated 
that no one had problems using the software. 

The quality of the audiovisual was also ad- 
equate. There was no discernable delay in trans- 
mission when only one computer at each end was 
involved in the chat. With three- or four-way chat, 
the quality of visual images deteriorated slightly, 
apparently due to bandwidth constraints, but the 
deterioration was not so bad as to create extra 
difficulties for the learners. All the learners indi- 
cated in the end of project questionnaire that the 
audiovisual quality was at a comfortable level. 

The discussion between learners went surpris- 
ingly smoothly despite the numerous concerns we 
had prior to the sessions, specifically: 


. The learners might react against the imposi- 
tion of a new technology; 

. The learners might find itawkward to talk to 
strangers, and consequently the discussion 
would not happen; 

. The topics might be too difficult for them 
to handle; 

. The learners might end up speaking mostly 
their first language; 

. Two-hour sessions might be too long for the 
learners to be engaged in conversations. 


None of these concerns were realized in the 
sessions. The learners on both sides showed no 
hesitation in talking to each other once we started 
the session and they all participated in the discus- 
sions with great enthusiasm. 

The learners spent more time preparing forthe 
class than they usually did. In other words, the 
challenge of the project produced aforementioned 
‘facilitating anxiety’ (Alpert & Haber 1960). They 
also handled the topics well. The unfamiliarity 
with some vocabulary seemed not to detract 
them from the task. The learners showed great 
teamwork especially the UC students, who were 
paired up and shared a computer. This arrange- 
ment seems to have worked well because of the 
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difficulty level of language the topics required. 
UC Learners were very supportive of each other. 
They all helped their UC partners when they 
had difficulties expressing their views as well as 
encouraging them to speak. 

This supportiveness was observed in the inter- 
actions between Australian and Japanese learners 
as well. The concern that the speaker with higher 
proficiency in their target language may end up 
speaking more than the other was unfounded. 
Most learners seemed to be conscious of how 
much each other was speaking and they voluntarily 
took turns to use the target languages. 

Learners were engaged for the entire two hours. 
None needed facilitation from teachers though 
some sought occasional help with vocabulary. 
Some students became sidetracked from the 
topic and started talking about the weather or 
their favorite music. This was the case particu- 
larly in the first session, because in addition to 
language constraints, most learners did not have 
enough understanding of the topic to discuss it 
for two hours. From the second session onwards, 
the learners were rotated approximately every 
20 minutes. This was very effective in keeping 
learners focused on the discussion, since they had 
to explain their viewpoints right from the begin- 
ning to different interlocutors every 20 minutes. 
This repetition seemed to help the learners build 
confidence. 

During the discussion, learners were very 
proactive. In order to discuss the topics, the learn- 
ers needed vocabulary they had not used before. 
When they came across a word they did not know 
or when they wanted to say something for which 
they lacked words in the target language, they 
used dictionaries rather than settling with words 
they already knew or using their native language. 
UC learners spoke Japanese spontaneously more 
than they ever had in the classroom situation. 
Although they still struggled with words, this did 
not discourage them. Even learners who normally 
were unwilling to speak Japanese inthe classroom 
were talking to their Japanese partners for the 
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whole session. Compared to discussion classes in 
previous years in which learners discussed issues 
in Japanese with their classmates only, learners in 
this project were a lot more engaged and talked 
more extensively. 

When this project was first announced, learn- 
ers at UC found it an exciting idea but they were 
unsure of their ability to perform such oral tasks. 
However, at the end of the project, learners were 
pleasantly surprised with what they achieved. 


Reflection on the Project 


After the project, a survey was conducted to 
collect learners’ reflections on the project. It was 
noticeable that learners were highly motivated 
in the project. Theories on motivation abound, 
however, for reflecting on this project, I chose to 
refer to Williams and Burden’s (1997) definitions 
of motivation. According to Williams and Burden, 
motivation can be construed as follows: 


Astate of cognitive and emotional arousal, which 
leads to a conscious decision to act, and which 
gives rise to a period of sustained intellectual 
and/or physical effort, in order to attain a previ- 
ously set goal (or goals) (p. 120). 


They propose that the first stage of motivation 
gives the learners reasons for doing a given task. 
At the second stage, motivation encourages the 
learners to decide to actually do the task. At the 
third stage, motivation enables the learners to 
make a sustained effort at learning. In relation to 
the classroom activity, specifically, they point out 
that: “It is important to emphasize .. .that motiva- 
tion is more than simply arousing interest. It also 
involves sustaining that interest and investing 
time and energy to make the necessary effort to 
achieve certain goals” (p. 121). 

Emotional arousal, the very first stage of 
motivation, can be brought on by the learners’ 
curiosity and interests. The learners were in the 
class because they had varying degrees of inter- 


est in certain aspects of the culture of the target 
language. They also have some external motiva- 
tions, suchas the need to get a good enough grade. 
Thus the learners already have some reasons to 
learn. The question is whether the iChat project 
added to their reasons. 

In the project, the learners were facing people 
who were not only native speakers of the target 
language, but who were also generally ina similar 
age group, and in a similar social background to 
them: university students. This could have had a 
positive effect on raising their interest. Further- 
more, having face-to-face communication with 
someone on the other side of the world, though 
increasingly common outside the classroom, could 
be exciting by itself. Moreover, they were talking 
to people who are currently in the country whose 
language they are interested in. Hearing that their 
partners are having a hot day in Japan when the 
weather has been freezing cold in Canberra, 
though banal, adds an extra level of interest. 

The next stage of motivation, deciding to take 
action, was strongly encouraged by the circum- 
stances of this project. They were chatting in 
formal class time and were facing their partner 
through computer screens in a lab situation. Al- 
though students were not forced in the sense that 
teachers came to them and made them talk, there 
was avery strong expectation that they work on the 
task. This seemed to have worked well as it gave 
enough incentive for them to start the discussion 
and break through the initial shyness which many 
students said was the hardest part. 

In addition, the project hadtwo characteristics 
that may have contributed to reducing the learners’ 
anxiety and helping the learning process. 

First of all, the learners in this project had a 
more private interaction than they normally do 
in the classroom situation. This characteristic 
relieved them from the worry of embarrassing 
themselves in front of their classmates and also 
allowed them to form a sustained academic com- 
munity of practice with their partners at UC and 
in Japan (Wenger, 1999). This is the most likely 
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reason for their mutually supportive and collab- 
orative behavior during the project, and may have 
helped in reducing debilitating anxiety. 

Secondly, since learners in each university 
were seeking to communicate in the language 
that they were learning, when they helped their 
counterparts with expressions in their own first 
language it seems to have created a very positive 
collaborative environment. Pairing non-native- 
speakers with non-native-speakers, rather than 
with native speakers who constantly help them, 
might have spared them from feelings inadequate 
or inferior. 

Finally, unlike real everyday social interac- 
tions, the topic was predetermined. Therefore, 
learners were free from the extra worries that are 
often associated with face-to-face communica- 
tions such as the appropriateness of the subject 
they might choose. 

In relation to motivation, there is a preceding 
research by Leontiev (1981) that is similar idea to 
that of Williams and Burden (1997), but referring 
to the concept of stress and tension, that seems 
to capture what this project produced well. He 
explains that stress can bring two very different 
types of tension, one purely emotional and the 
other operational. These two have very different 
effects on learning outcomes. Emotional tension 
results in temporary loss of ability to make the 
best decision or strategy, whereas operational 
tension generally makes one more focused and 
improves performance. Thus, Leontiev (1981) 
concludes that “...the teacher’s task consists in 
creating a climate which will avoid states of 
purely emotional tension in the students but, on 
the contrary, will stimulate the emergence of 
operational tensions” (p. 71). 

In this project, learners had to communicate 
using one of their poorly developed macro-skills, 
the speaking skill. Naturally, this would put them 
under some stress. However, there were features 
of this project which possibly reduced anxiety 
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or what Leontiev calls emotional tension. Thus 
the learners might have experienced less of those 
negative emotions in proportion to the operational 
tensions. This could have increased their concen- 
tration and engagement in the task. 

The effect that the technology had on sustained 
learning is hard to evaluate since no longitudinal 
observations were carried out to provide empiri- 
cal evidence. However, there were some positive 
signs. The students seemed to have performed bet- 
ter in end of term oral presentations than similar 
students had done previously. Furthermore, in 
their end of term survey, almost all of them com- 
mented that they felt more confident in their oral 
communicative ability through this project. 


Further Developments and Future 
Trends 


Inthe future, we hope to have this video conferenc- 
ing facility set up permanently so that language 
learners can use it for self-study. It will provide 
more opportunities for them to practice their 
target languages and it could also foster further 
affinity and positive attitude to the culture of the 
language. The importance of this positive attitude 
in language learning has been noted by social 
psychologists (for more reviews, see Dornyei & 
Skehan, 2003). 

ASU later incorporated ‘podcasting’ as a task 
in their language studies. ASU students would 
recordan audio commentary in their own language 
(Japanese) on the topic they were to discuss in the 
next week. They then uploaded it to the ASU uni- 
versity Web site so that UC students could listen 
to the commentary in Japanese before coming to 
the discussion. Through the podcast, UC learners 
could not only use the commentary to prepare for 
the chat sessions, they could also use the same 
commentary for listening practice. This could 
prove a very useful way of integrating iChat ses- 
sions with other language learning tasks. 
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CONCLUSION 


The project started with the intention of break- 
ing learners out of their shyness and anxiety and 
getting them to talk. Observations during the 
project suggest that learners talked much more in 
the target language than they normally would in 
the classroom situation. Clearly, further empirical 
study is necessary before drawing any firm conclu- 
sions on the linguistic outcomes achieved through 
using iChat. However, there are certainly some 
very positive signs, which are sufficient to justify 
further exploration and research on this technol- 
ogy as a tool for the language classroom. 
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KEY TERMS 


Audio-Based CMC: CMC based on audio 
communication. Internet telephone, such as 
Skype, is considered to be audio-based CMC. 


Audio-Visual CMC: CMC based on video plus 
audio, so that both audio and visual information is 
available. Internet video conferencing and video 
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CMC: Computer mediated communication 
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software, which enables two or more people to 
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